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A major focus of the psychology of instruction is 
understanding and facilitating the changes in cognition and 
performance that occur as an individual moves from low to higher 
competence in a domain of knowledge and skill. A new program of 
research which examines the initial state of the learner as a_ 
component of this transition in competence is described in this 
8-part document. Part 1 introduces two previous attempts to relate 
aptitude to instruction: differential aptitude tests and aptitude 
treatment interaction. Part 2 provides an overview_of the two^ general 
research approaches to aptitude analysis^ the cognitive correlates 
approach and the cognitive components approach. The approach taken in 
the present research effort is described as a task analytic approach 
that considers basic processes^ executive strategies, and content 
knowledge in aptitude test performances of skilled and less skilled 
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reasoning and general ability. Common generic properties of inducti 
tasks are discussed as are different types of inductive items on 

aptitude tests. Part 4 outlines earlier theories on analogical 

reasoning performance. Problem features, processing models, item 
processing data and theory, item errors, and performance are analyzed 
for f igural, numerical, and verbal analogy solutions in parts 5 
through 7. A final part discusses results of research, concluding 
that a number of interrelated factors differentiate high and low 
skill individuals. These factors include management of memory load, 
organization of ah appropriate knowledge base, and procedural 
knowledge of task constraints. (LP) 
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i. INTRODUCTION 



A major focus of ihe psychology of instmction is understanding and facilitating 
the changes in cognition and performance lhat occur as an individual moves from 
lou iu Higher competence in a domain of knowledge and ski'l. A framework tor 
research devoted to analyzing this transition in competence can be specified in 
terms ol several integral components. The^c are: (I) the nature of competent 
performance and of intermediate states; (2) ihe initial I performance state of the 
learner; (3) the transition processes between this initial state arid a state of 
competence, and (4) the monitoring and assessment of performance changes 
(Atkinson &. Paulson, 1972; Glaser, 1976). We are concerned here with the 
second component — the initial state of the learner. Instruction begins with the 
learner's initial knowledge and skill, and proceeds forward from this base. These 
initial state characteristics facilitate or retard the learning of subject-matter com- 
petence. They are comprised of subject-matter skills that can assist in learning 
and that are transformed into more advanced states of competence: Initial state 
also consists of learning skills that contribute to the acquisition of new knowl- 
edge. This chapter describes ihe beginning of an attempt to gain theoretical and 
practical understanding of these skills for learning. 

There are a number of ways in which the initial competence with which an 
individual begins a course of learning has been considered in educational prac- 
tice. One is assessment through the use of aptitude and intelligence (est scores 
thai are predictive of scholastic achievement. A second is the diagnostic assess- 
ment of a student's strengths and weaknesses in a subject matter that might be 
attended to in remedial programs in the course of specific instruction. A third, 
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SL..rr, 19/b. '> ,cr ' ' „ we base oar conclusions about what 

intelligence m some abstract way. Ra h.r pr ,mcive validity. 
th cse tests measure on most ^ m J m are Rcipiui in 

lh ,„ the verdict ,s hat M - ^ understantling „f these abilities .or 

learning. HUvitisfaction with such tests tor three 

, oomi „ 6 a„d *B,^« *^*g * under: 
which lead to success in school. 4 
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Willi the above needs m mind, our program of research uses the concepts and 
hu-lluuN 01 conn, live psychology to analyze the intellectaal tanctions assessed by 
measures oi scholastic aptitude. The eventual goal is to understand the consis- 
tent processes and content involved, and to show how they can be influenced 
thuuich instruction Bdoic u> describe our analyses however, it is approi .lc to 
,cv.ew buellv hui previous attempts to relate measured aptitudes to dillcrcnl 
learning cu\ iroiimeiiis. 

A. Previous Attempts to Relate Aptitudes to Instruction 

1 l>:Vu /< /?//.;• \;>nut\tcs. ISyehomctncians have not been remiss in at- 
u . M ! p inu: ili pu.Iv deeper nito Hie dilterenl tacets of human cognition so that tests 
: U[ ^ ;, w tiiote v:hoii\c to individual dittcrenccs Some >ears ago, dissaiistac 
- T. iiumuH nn the in and on multiple factors led io a de-emphasis ol the 
."o.Up, l\ Lci.li.ii intelligence and increasing popularity of differential aptitude 
jjj* 'in ;< K l\M\ iii i" -I"' detail measure oi general aptitude, schools began to 
„ pl , , . , • (iM- piOvidcd measures ol a variety oi I actors such as spatial, 
„.. w . t ! Mu a^n ict reasoning: These lest hatlenes attempted to predict 
sin-VjsN .ii vocational piogiams that appeared to require dilterenl aptitude pal- 

ll "in ioo4, ..uciul ahaUsis w as done by McNeinar ol the validity coefficients 
,,j tU u^d different! d aptitude batteries He argued trom his analysis 

ih ,• • V.;dc iioni tests ol nuniencai ability having differential value tor predict- 
m *, ■ ... .o| ,,; R !,s ni math: it seems sale to conclude that the worth of multitest 
h uieiies as diiteienlial predictors ut achievement iii school has not been demon- 
,- h itL . u ji ^ tar trom clear that tests of general intelligence have been out- 
n^-jed bv the u.ull.lesi batteries as the more Useful predictors of school achieve- 
ment ip S7^ s Sio.e recent work rcalhrms McNcmars conclusion (Carroll. 

I o .\s i _ - 

I bus the attempt to iutlher ditferentuite specific ability patterns and relate 
ihein to spceiiiL educational programs was, at best, no more successful than the 
use o! -e.ie.al abihtv measures Dittcrential aptitude tests followed the accepted 
pract.ee of attempting to predict the final outcomes of learning, and did no better 
iti in geiicial abiluv tests iii attempting to identify and measure abilities that could 
be related to models of learning: and to prerequisite skills required for learntng 
various tasks. McNenur (IW>4) reflected on a possible reason tor this lack ol 
success and staled the following: 

■Vbiiiiies oi eapaeiiicv iii aptitudes, or .ntetleciual skills, or whatever you choose 
, 4 ; c .11 iheiii Wiv incasuied in tenns oi response products to standardized stinuilus 
. siiiiiitinns The st.niuius is presented to an organism which by some process comes 
up vMiii a response, thus anv atiempl id theorize and/or study intellect in terms ol a 
simple sninulus. response IS Ki paradigm seems doomed to lailure unkss dra.i, 
^jj v nnuiuicd :i!id complicated by the insemon of O lor organism and P tor 
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process. . . Studies of individual differences never conic to grips with the proems, 
or operation by which a given organ.stit achieves an intellectual response, indeed, it 
i> dilliculi In see Mi)* Hie available individual diiierenee data can be used even a.-, a 
Mailing point lor generating a theory as to the process nature Of general intelligence 
or of any other specified ability, (p. 881) 

2. Aptitude-Treatment Interaction. Psychologists and educational re- 
searchers have been concerned about the relationship between measures of indi- 
vidual differences and learning variables. To a large extent, this work was 
heralded by the 1957 book by Cronbach and Gleser entitled Psychological Tests 
ami Personnel Decisions and its second edition in 1965; This book developed a 
deeis.oii-theorv model tor the selection and placement of individuals into various 
••treatments: The word treatment was given a broad meaning, referring to what 
is done with an individual in an institutional setting, e:g: . in education it refers to 
the particular programs or instructional methods a student is assigned to or has 
the opportunity to select. This theoretical analysis pointed out that aptitude 
information is useful in modifying and selecting treatments only when aptitude 
and treatment can be shown to interact. This research is different iron, that ot the 
previously mentioned work on differential aptitude testing m which emphasis 
was placed on determining the relationship between measured aptitudes and 
learning outcomes resulting from relatively fixed curricula. In the A I I work the 
emphasis is on determining whether aptitudes can predict which ot severa dit- 
lerent learning methods might help different individuals attain similar educa- 
tional outcomes. : 

Comprehensive reviews report detailed analyses ot AT I studies i Brachl. 1969. 
tirachl & Glass. 1968). Cronbach and Snow (1977) have carried out a very 
extensive review arid analysis of many of the ramifications Of the A l I problem. 
The-, conclude thai, with a few notable exceptions, ATI effects have not been 
solidly demonstrated. The frequency of studies in which the appropriate interac- 
tions have been found is low and the empirical evidence found in tavor ot such 
mteraciioris is often not very convincing. In those occasional instances when 
positive results have been obtained, no general principles have emerged because 
of the lack ol consistent findings in replicated studies and in transter to new 
subject nialler tasks: 

While one is struck by the absence of any prescriptive assistance to mstruc- 
iioh certain sections of -he Cronbach and Snow book suggest a trend that bears 
further study: A pattern of more promising results appeared in situations where 
investigators were forced to construct an aptitude measure because no ready 
mu de and labeled aptitude tests were already available: There appears to be a 
iradeoff between the reliability offered by established tests ol aptitude and the 
information about acquisition processes afforded by tests specially constructed 
for experimental work. In research using specific aptitudes it seems as though 
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researchers presumed that trie label of a particular aptitude measure had direct 
implications for instructional practice K>i ^xanipie; a spaiiaj apiiiude iesi was 
paiicd \v tili procedures that de-emphasized verhal content in instruction. Bui ihc 
irieic absence of Words (diagrams* for example) by no means implies the pres- 
ence oi abilities required in these tests; 

lhe-.e i c suits certain is Jo not recommend that standardized tests be aban- 
doned ;is inappropriate measures in ATI research- -the fault in these etlbrts 
.:ppe.i'rN :o be in the absence oi adequate theories of lest performance rather than 
m the tesK tilcm'sels cs. Hie clear need is linn the use of traditional psychometric 
insiviiiiiL hN wdl Have to be accompanied by careful analyses of processes thai 
lei.iic .iptiwde. hcatmenl, and the knowledge or skills being learned. Testable 
iu .-ie*; ire ii-ijiiik-J that describe competencies measured in the pretest, com- 
peviiLus w\\ -ired lot task pcrtoi mancc , and treatment procedures that connect 
:i«e . iWKu At the present lime, generally used aptitude constructs 

AU - i\, \ p lk »Jiii ir:e dimensions t < h measuring those individual ditterences that 
i: ,:.-i. K ! Aiil: diltcieht sv.Os of learning: These measures, derived from a 
; ■ ■ w lio'-i/iiu sclcciioii-iineiited tradition, do not appear to relate to the processes 
. .! .evaii.ii-- a:id pet h iniiaiice dial have been under investigation m experimental 
: .! k -v-."v-iM::ent:il p-A ehoUig* The n eat me ills investigated in ATI studies have 
-v.-: ; ecM-iafed b\ aiiv systematic analysis of the kinds of psychological 
: .- , ;. ■•;>;..■ : ; .died ':•:*> >\\ ill pameaiat instructional methods, and individual dil- 
■ o, , i,ec?' isMcssc-d in tuiins ot related performance proeesses. 

it iJUtTiiitive Performance and Individual Differences 

! , : - . , . d i ihc rt Mills obt tilled from such endeavors as diflerenlial 

ie'si.iie aiid Al l lesearch has Iven learned slowly: in 1^57, Cronbaeh 
, ' si. -.a C o r iiucis originating in dilUrenlial psychology are now being 
\'i.\\'u> evpeiimchtal variables As a icsUlt, the whole theoretical picture in such 
,i:ei .;s iiusiiaii abilities is . hanging . . It now becomes possible... ulli- 
■ji.itcb, v iihitc the psychology ot intelligence with the psychology of learning" 
>y. r>s2i The point Was reiterated in 1972 by Cilaser who called for research on 
ilie "hew aptitudes" it tat * oil Id be interpreted in terms of process constructs. 
However, ilie lilies' ol research reported in this chapter have only recently begun 
ro coiueptuali/e individual difterences in aptr.udes in terms of structure and 
process constructs ol contemporary theories cf human cognition arid cognitive 
development . 

I lie particular orientation and the specific problem thai we address can now be 
sueeiiiclK slated The global objective is to contribute to an understanding of the 
ttajs in winch individuals differ in abilities fur learning. In the long run, our goal 
vv i It be achieved if we can couch ahililies to learn in terms of the concepts of 
modem cognitive theory, and then develop procedures for identifying school- 
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related capabilities based upon these interpretations. In this chapter, our inmal 
step is to accept the robust correlational tact of a relationship between certain 
abilities measured by test tasks and school achievement. We then identify classes 
of test tasks that have consistently appeared oh scholastic aptitude tests and use 
current techniques of task analysis to understand the nature of the performance 
elicited by these tasks. A logical next step would be to relate the aptitude 
processes to similar task analytic work being pursued in school subject matter 
areas, e g:, beginning reading, text comprehehsibh, elementary arithmetic, sci- 
ence problem solving, etc. Such an approach should begin to explain the predic- 
tive validity of the skills of learn mg measured by scholastic aptitude tests, and 
the reasons lor limitations in validity, and may suggest how instruction could 
improve the intellectual performances involved. As Carroll (1978) has written: 

The performances required on many ty pes of mental ability tests— tests of language 
competence, of ability to manipulate abstract concepts and relationships, ot ability 
to apply knowledge to the solution of problems, and even of the ability to make 
simple and rapid comparisons of stimuli (as in a test of perceptual speed)— have 
great and obvious resemblances to performances required in school learning, and 
indeed in many other fields of human activity. If these performances are seen as 
based on teamed; developed abilities of a rather generalized character, it would 
frequently be useful to assess the extent to which an individual has acquired these 
abilities This could be for the purpose of determining the extent to which these 
abilities would need to be improved 10 prepare the individual for further experi- 
ences or learning activities, or of determining what kinds and amounts ot interven- 
tion might be required to effect such improvements. These determinations, how- 
exer would have to be based on more exact information than we now have coneem- 
mg .'he ettceis of dillerent types of learning experiences ... on the improvement ot 
these abilities, (p. 93 94) 



II. APPROACHES TO APTITUDE ANALYSIS 



A. Overview 

Within this developing area of aptitude research, there appear to be two general 
research approaches (Pellegrini Glaser. 1979). The first of these which we 
have termed the -cognitive correlates- approach, seeks to specify the elemen- 
tary information processes that correlate with high and low levels ot aptitude 
Scores on tests of aptitude and intelligence are used to define subgroups to be 
compared on laboratory tasks that have relatively well-defined processing ^charac- 
teristics The particular tasks chosen and their hypothesized underlying processes 
can' be interpreted in the broader context of general models of the human cogni- 
tive system: Examples of this type of research can be found in the work ot Hunt 
arid his colleagues (e.g.. Hunt. 1976, 1978; Hunt. Frost. & Lunneborg. 1973; 
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Hunt *V l.arisihafi. The second research approach, which we have termed 

t he " 'cognitive components** or "task analytical " approach, attempts to directly 
idehtiiv the information processing components of performance oil tasks used to 
assess apiiiudc. In this approach, performance on psychometric test tasks bc- 
coincs i he object Lit theoretical and empirical analyses: The objective of this work 
is to develop models' of la.sk performance and to use these process models as a 
b tJ >!s tor individual diltciehce anal) sis; Examples of this type of task analytic 
i esc.it i. I: iiieliiiic the discussion b\~ Lstes 1 1^74) aiul the recent work of Pellegrino 
,v i i laser il k >Sio. Sieiiibeii.' U l >77i. and Carroll (l°-76): 

•\s .j result ol urn review 01 iccent aptitude research (Pellegnno & Glaser; 
l k J 1 i i . c»e have aigiicd dial the Cogimive components approach incorporates the 
i ;»ei»!ii^e-iiMici;ues Approach, avoids the explanatory inadequacy of indirect cor- 
rc;.iti»»:;.il 'is ■liiO.U. aiid lias the theoretical power to consider differences on 
\.tii>".i> duiiciisoii-, ol cognitive functioning: Cognitive correlates research lias 
I v }'!-.. !,h u>i',i i>ii ielativeiv simple processing tasks that measare the speed o! 
.uccsmii! LOi'L - iii long te f it i memory" or manipulating information in short-term 
.nemo?* However, piocessnti: speed is only one of several cognitive eompo- 
f . o! ; oiiipies f.isks: Many memory and problem-solving tasks require 
ii.-.'lie: icvei executive ajaiegiCs that facilitate the appropriate sequencing of 
\s;:;g actrvmes such as the activation and manipulation of memory 
> < ^ i iv <. ■ v speed and Loordiiuuon ot these higher-level operations 

o ^ i! o.i i j ,,i«-.suiiitudi\ to individual ditlciciKcs in performance, partuu 

< 1 l iiureasLS ;u Msk comj A \it\ invoke increased demands upon limited 

; [ r vc .iiJ piou.ssinj icsouues lhus it heroines important to ruse 
j : > : ,-,s : t -ut dual diitLruv.es in executive routines.'" which have be- 

i . j i u in >st ^o.zrntivc thtones Iii ui Jit ion semantic or declarative 

know !L\!ee siti^iiiies toithei detenu me how task content is encoded and repre- 
Aciitc! .uid how u interacts with processing capabilities: These structural prop- 
enii-s iiiliiieike sloiagc capacity . knowledge organization; and the availability of 
diileieiil r v" pes ol semantic and procedural knowledge. 

( )L:t piogiaiii of research employs a task analytic approach that attempts to 
cor. sulci these iiiu tails dependent aspects-- ''basic** processes (automatic and 
Controlled attention-demanding processes), executive strategies, and content 
knowledge in the analysis of the performance characteristics of skilled and 
less skilled perinrinci s on aptitude tasks. Work to date indicates that the analysis 
ol high arid low aptitude groups shows differences in the speed of accessing 
stored me mots repiescntatiorLs. Task analytic studies ol* performance on 
psychometric tasks implicate the efficiency of executive control and the knowl- 
edge structure properties; These are potential sources of individual differences 
i hat ate i elated to dev eiopineniai level, educational history, and general experi- 
ence \u adequate explanation ol individual differences in aptitudes lor learning 
must come to grips with these interactive aspects of information processing. 
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B. A General Analytic Scheme 

Before proeeed.nu id a discussion of our research: we mus, bfielly Lfcscr.be «hc 

•Sui P iLncWork and unaiy.ic '^^f-^T?^- 
which has evolved from our own work and .ha. ol others .see Gla.scr ^ Pcllcg 
rmo. 1978): prescribes ilie following stages and se.s ot tssues. 

, The firs. s.ep in a systematic analysis of individual differences in aptuudes 
tllr earnmg is .o identify (he domain of .asks assorted with u» aputade .actor 
B s we mean identifying a core set of .asks .ha, frequently occur across man 
w.dciv used tests and .ha. have been shown, in iac.or-ana.S K: s, jhe U> have 
eoiis.steiu relationships to certain basic apu.ude eons.ruc.s. 1 hus. the tusks cno 
J i nalvs.s should have: (ii reliable association with a reasonably genera. 

nude cohs.ruct. and .2, consistent pred.c.ive validity wi. respec. .o a erne- 
on performance of significance ..or example, academic achievement). 

V,, lieuuu.e understanding of individual deferences m a particula a P ,,,udc 
e m i . be based upon an .n.ens.ve analys.s of only a single .ask With a high 
Sll t hat apu.ude construct. Rathe, « .s necessary to conduct analyses hut 
, h vanous mtercorre! „cd tasks thai define more completely a suh.s.un- 

' rl . am ] stx .eilie cognitive processes and help tocus on a IlvU ot analysts 
" tch ,- n identify .he ex.en. of process tramabili.y and transfer elteets. 

J c „ne it s hen necessary . develop and val.date mtormat.d Passing 
Ills .or .he dtfferen. .asks. The theories and mode. s can be- ^ -ed ' °n 
computer siiiiuio.ton programs and/or emp.ncal studies o, Qu jA Us of ^ 
p.opcrt.es on latency: sdu.mn protocols, and error pa te ns. I hep. mod. s n as 
diltereiittate between baste cogtutre processe-. and higher-level strategy that 
e ^ p ess integration and sequencing: This tlex.btb.y is necessary because 
uMliroi ^iull.^ b HittW.Mit levels as a unction ol inc 



tion ot the two. 
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j the thud major slop in the analysis is to use the models 01 Uisk perfor- 
mance lis ihe basis tor individual differences analyses in each task. In this way, 
Uie utililN ol a model lor explaining the source(s) bl individual diH'erenees can be 
turther lesied and validated. Individual differences can be investigated in terms 
ol the parameters of a model, or in terms of the applicabilil> of different models 
lot the pertormance oi' dirieieiii individuals. Sueh an analysis must also investi- 
gate me sources ol de\ eiopmeniai differences. !i is necessary lo map oal the 
Lclai:onsiup between o\ei\tii des eiopmeniai change in menial ability and sources 
of individual diitcunces within separate age groups. There is no reason to 
:iNN[.;is;- ihe sources of mdiMduaf differences within one age group are neces- 

sjniv aiipjicjhle to iiidi\ iduals at a higher or lower maturational level. 

hie next step m ihe analysis of individual differences is the examination ot 
h -.s Msk v , !is.stene\ in sources of individual differences. Based upon the re- 
siiiis "i iiie preceding steps, one can then attempt to specify and test the cognitive 
voiii!u ; iie:ii-. imi: ate tvheial across all task forms repicsentative of the aptitude 
Jt.h^iiu. i ■.!..; i-.i.iiiiple. .ill induction tasks), and those that are_ specific to a given 
j.r.K lour, oi ^'iiichi .iiea In this work, the attempt should be made to account tor 
sie'.J panels oi relationships" found in the psychometric literature. _ 
\w mJ iaici iiages of iliis research, as individual and developmental dit- 
\ : :ci.. :s m co'eriiii^e processes are identified, woik can proceed on the analysis 
. •n." : .Mi iasks siniiUii to those Used to establish aptitude test validities.. The 
. r cttiij'i is to idcimrv process and ktnnv ledge structure characteristics bl 
-. . c peMoi liian.e that account lor the correlations of aptitude measures with 
.r .u iiou jierloimance Concurrent!) ; research can be carried out on the 
■r.odiii.ipii';i> iin'd ihsiriiciabihis of these characteristics of intellectual function- 
as mes ^cKc to support or enhance an individual's abilities for learning. 



III. INDUCTIVE REASONING AND GENERAL ABILITY 



A. Overview 

Our woiK ,i>vcfs pruuarilN the earl> stages of the general analytic scheme de- 
x.iibed ahiuc In this chapter, we will focus on die analysis of performance on 
tasks representing a central aptitude or ability factor— the induction factor. We 
hive chosen this factor because the tasks thai load highest on the inductive 
icasohiru' t actor also load the highest on any general factor furthermore. ihe 
task tonus cat across all the major content dimensions. Thus, many forms ot 
s< mhohc input serve to assess inductive reasoning skill. Also, this general factor, 
winch can be extracted trom most aptitude and intelligence tests, is the single 
hesj predictor of academic performance and achievement test scores (Snow, 

i^M>:>i 
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AH inductive reasoning tasks have the same basic form i or generic property: 
The individual must induce a rule governing a set of elements. Thus, a set ot 
elements is presented and the task is to infer a pattem or rule structure thai will 
allow generation or selection of an appropriate continuation, or verification that 
the pauern as shown is legitimate. This generic structure is manifest in a variety 
of task tonus ranging from simple classification problems to highly complex 
matrix items. Figure 5.1 provides an illustration of the various task forms as- 
sociated with inductive reasoning: Also shown in Fig. 5.1 arc the different 
content dimensions that are typic Jll> utilized tor a given task torm for the verbal 
and t luiiral classification problems, the task is to determine the relationship 
(semantic, logical; geometric, etc.) governing the base set and select the alterna- 
tive that is consistent with the interred rule. In the case of the letter and number 
series problems; the task is to determine the relational and periodic structure bl 
the element string and extrapolate it to complete the blank spaces. The tigural. 
numerical, ami verbal analogy items require the individual to choose the alterna- 
tive that is i elated to the ihiid term in the same way that the second term is related 
to ihe first. The namcncal analogy is a similar torm of this task that uses two 
initial item pair- to reduce ambigmt) in specifying the appropriate type of rela- 
tionship jovcininu the problem Hnallv the tiguiai matrix problem requies the 
iiui'vidiiai to select the alternative that l ompletcs the matrix and that is consistent 
\vith the relationships governing the column and row structure. 

Induction problems have been a part of aptitude tests almost tront the incep- 
tion ot the teMirig movement. One or more of these task forms can be found on 
wfiualK any standardized aptitude or inielligehce test at any development levei. 
As an example, the Cognitive Abilities Test (Thorndikc & Hagen; 197 1 ) includes 
the fojknving item tvpes in its multilevel battery intended for grades 3-12: verbal 
classification and analogy, number series, and figural classification and analogy. 
The Ra^en Progressive Matrix Test consists entirely ot tigural matrix problems 
o\ the iv pe shown in Hg. 5.1. Multiple aptitude batteries sueh as the Uilicrcniul 
Aptitude Test and the Primary Mental Abilities Test provide separate inductive 
reasoning scores. Evidence is available for the claims that inductive reasoning tasks 
ire < 1 ) highly correlated with academic achievement, (2) load the highest on a gen- 
eral factor Extracted from performance on inulntesi batteries- and (3) diller in their 
intercorrelations as a function of task form and content domain. To illustrate 
these pbu.rs. we focus on data available for the Cognitive Abilities Test. 

In assessing validity, the CAT provides three separate scores representing 
performance on verbal, quantitative, and tigural problem types, each ot which is 
related to academic achievement. When CAT verbal, quantitative, and figural 
performance scores are correlated with achievement test performance as mea- 
sured by the Iowa Tests of Basic Skills, the average correlations over grades 3-8 
are uniformly high; as shown in Table 5. 1. A similar pattern emerges when CAT 
performance is correlated with actual school grades. The specific subtests that 
contribute to these three separate CAT scores are shown in Table 5.2. This table 
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CLASSIFICATION PROBLEMS 



mdui* wolf bear A rose B. lion C. run 0- hungry E. brown 

Bob Jack Fred Bill A Mary B. boy C. name 0. Ed E. J°n« 



m w A Q "o I* D 0 
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SERIES COMPLETION PROBLEMS 

Number Series 

32 M 33 15 _34_ 19 .35 . - - - - 
_ 72 43 90 71 47 85 70 51 80 

ANALOGY PROBLEMS 

Numerical (A: B :: C:D E:F') 
7 21 :: 5:15 :: 4 



15 19 :: 8:12 5 
10 40 6 36 5 
28:21 :: 24:18 :: 20 
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F|G. 5.1. Tusk foriife associated with inductive reaching: 
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Table 5.1 

Achievement test Correlations for the Cognitive Abilities Test 



CAT Form 



Iowa Subtest 



Verbal 



Quantitative 



Non-verbal 



Vocabulary 


:81 


.66 


.55 


Reading 


.80 


.66 


.56 


Language 


.78 


.69 


.57 


Work Study 


.77 


.74 


65 


Arithmetic 


.73 


.77 


.62 



also provides the loadings of each subtest on the general factor extracted froin the 
pattern of subtest iniercorrelations. In each grade, the induction tasks have high 
loading on the general factor. • __ 

Interrelations among verbal arid figaral induction tasks are shown in Table 
5 3. The pattern of correlations is indicative of relatively strong relationships 
among all the induction tasks. However, the pattern also shows that intercorrela- 
tions are stronger within content domains (double-underlined coefficients) rather 
than for common task forms (single underlining); i.e., the verbal-verbal and 
figural-figural correlations are higher than the analogy-analogy and 



Table 5.2 
Subtest Loadings oh a General Factor 



Subtest 



Verbal 
Vocabulary 
Sentence Completion 
Verbal Classification 3 
Verbal Analogies 3 



Quantitative 
Quantitative Relations 
Number Series 3 
Equation Building 

Non-Verbai 

Figure Classification 3 
Figure Analogies 3 
Figure S ynthesis 



Grade 



11 



.68 


.67 


.67 


:71 


.67 


.77 


72 


.73 


.72 


.73 


.82 


.78 


.70 


.74 


.70 


.79 


79 


.80 


.83 


.81 


.72 


.76 


.74 


.85 


.85 


.80 


.83 


.82 


.82 


.82 


.74 


.75 


.79 


.73 


.68 


.66 


.64 


.67 


69 


.76 


.74 


.73 


.77 


.76 


:78 


.60 


.64 


.62 


;58 


.64 



a Deriotes induction tasks 
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. Table 5.3 

Correlations Among Verbal and Figurai Induction Tasks 



Ty pc of 
Induction Tdsk 




(Grade 3 






Grade 7 




Grade 1 1 




VC 


FA 


FC 


VC 


FA 


FC 


VC FA 


Fe 


Vefbdl Analogy 


HA 


M 


.55 


■32 


.63 


.54 


.7J :63 


.62 


Vefbdl Classi ticutior 




.63 


31 




.56 


■31 


56 


.53 


Hujurdi Aridlocjy 






32 






:6§ 







(VtJ^e. VC - Verbal Cldssiticdtibh 
FA - Figurdl Analogy 
FC - Ficjiiral Classiticdtibh'Type of 



L iasNitu\iiii>hclUsNi!icaunn correlations. Finally, it should be no led thai in both 
Iables .i 2 and 5.3, the analogy task seems to be one of the most stable in its 
patterning d1 factor liKiJiruis and inlercorrelalions. This is consistent with the fact 
that the analogy task is a most prominent induction task. 

The extensive use of analogy items in intelligence and aptitude tests was 
documented b> Oawis and Stojo (Note 1), and more recently, Sternberg (1977) 
has prouded a detailed review and discussion of the import ahce of analogical 
reasoning Aithin the tteld of differential psychology. Spearman (1923) and 
Kaveii t l l MiS) both argued that inductive reasoning was central to the concept and 
measurement of intelligence. The only debate about the different task forms and 
content dimensions is whether they represent a single aptitude construct or can be 
subdivided into separate aptitude factors representing different relational types 
such as the induction of semantic as opposed to figurai relations. 

Rule induction tasks are not simply a psychometric curiosity, but are relevant 
in the broader domain of cognitive research and theory. Greeno (1978) for 
example, has characterized rale induction problems as instances of a major type 
oi piobleni solving task within a general problem typology. He has also 
suggested thai comprehension can, in many respects, be viewed as a special 
instance of rule induction: Simon and Lea (1974) have discussed the similarities 
between the processes utilized in rule induction, as incorporated in their General 
Rule Inducer program, and the components of concept formation as Used in a 
program developed by Gregg and Simon (1967). Simon and Lea liken the in- 
stances presented in a concept attainment task to the elements of a series comple- 
tion problem. Egan and Greeno (1974) consider rule induction in the framework 
ot semantic memory research, and have pointed but thai analogical reasoning, 
series completion: problem solving, and concept format ion all require a search 
for relations among elements resulting in hew interconnections between the 
nodes of a network structure. In this same semantic memory framework, Nor- 
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man, Centner, and Stevens (1976) have argued for the essentially inductive 
nature of effective instruction: Structures of interrelated concepts are communi- 
cated to students by a teacher or through some other instructional medium. In 
order to comprehend and remember the material, the student must induce the 
structure of the presented information by detecting the relational pattern of the 
presented concepts and discovering the connections between the newly com- 
municated material and the knowledge structures already in permanent memory. 
The importance of inductive thought processes and reasoning by analogy has 
been emphasized in science (e.g., Oppenheimer, 1956), mathematics (Pblya, 
1965), and in the acquisition of information in the classroom (e.g., Brurier, 1957; 
Forehand, 1974). 



B. General Components of Induction Tasks 

The different inductive reasoning tasks described above have been the subject ot 
various empirical and theoretical studies. Serial pattern acquisition has been 
studied extensively in the psychological literature (e.g., Kotovsky & Simon, 
1973; Resile; 1970; Simon & Kotovsky, 1963; Viiz & Todd, 1969): The exten- 
sive theoretical analysis of letter series problems in the form of a computer 
simulation program (Simon & Kotovsky, 1963) has been shown to be applicable 
to process training with children (Holzmari, Glaser, & Pellegrino, 1976). Empir- 
ical and theoretical work has been done with verbal and figural analogy problems 
tc.i?.; Evans, 1968; Mulholland, Pellegrino, & Glaser. 1980; Pellegrino & 
Glaser, 1980; Reitman, 1965; Stern berg, 1977; Whitely; 1976). Figural matrix 
problems of the type found on the Raven's test have been discussed by Hunt 
(1974) and Jacobs and Vanderventer (1976): Rather than review each of the 
various studies in detail (see Sternberg. 1977; or Holzman, 1979, for detailed 
reviews), we would like to present a synthesis of these theoretical and empirical 
efforts in the form of a general model of the components representative of 
inductive reasoning tasks: This general model will serve as the background for 
our subsequent discussions of detailed models of analogical reasoning tasks. 

All inductive reasoning tasks can be said to require the following processes: 
(J j encoding or representational processes that depend on the information stored 
in permanent memory; (2) inference processes that identify and/or generate rela- 
tional features shared by two or more encoded elements; (3) rule assembly or 
monitoring processes that organize individual relational features into simple or 
complex relational structures; (4) comparison or match processes that can 
evaluate the similarities among relational structures; (5) discrimination processes 
capable of selecting among competing relational structures; and (6) decision and 
response or output processes. 

In inductive reasoning tasks, these processes are called upon one or more 
times during the course of solution. Differences between task forms and content 
domains; as well as differences in item difficulty within a given task, are a 
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function of one- or more of these components of solution. For example, letter 
series ptohicnis minimize encoding or representational difficulties by restricting 
the nature ot the content (the alphabet) and by using relatively simple relational 
features (identity next (A-Bj, and backwards next (B-Aj relations). Problem 
ditiicuii) arises in the rule assembly process, where discovery of the periodic 
^structure ot the pattern, (i.e.. period size) must precede discovery ot the complex 
rule governing the entire sequence. Difficult items are those having larger period 
lengths and more complex relational structures (see Holzman el al. 1976). In the 
east ol U^u il analogies or tigural matrices, there is a significant encoding or 
n.pre ^ntatumal component since one must often decompose complex and em- 
bedded patterns to identity the individual elements that are relationally trans- 
tot red f iieoding in J representational processes arc also Of obvio is importance 
Ki veihai lassiticaiion and analogy items because of the fuzzy nature of many 
^ctlui concepts and their tnulti -attribute internal representations: 

Another major di Mere nee among the various induction tasks is the number^ot 
ciiiisii jih'is on the solution to the problem. In a classification item, the inferred 
rule liiusi govern the entire set of elements. In a series item, the inferred rule 
mi-st he .ippiu able to each successive period and be capable of continued ex- 
tiapoiation In an analogy problem, the inferred rule for the first pair of terms 
inn's: he consistent in relation and direction with the inferred rule for the second 
pair "i terms Itnailv, m a matrix problem, the inferred ruie tor rows must be 
.ipt'luabie to all rows, the inferred role for columns must show similar cohsis- 
«L-;iw\ .i:iU the two sets ot rules must not be in conflict. The number of dittereni 
v.>usi:.uii[s oti Una! solution altccts item and task difficulty by either requiring 
:ha( nioic information be held in working memory, or thai encoding, inference, 
Mile asscmbiv; comparison, and/or discrimination processes be executed re- 
peat cells to achieve an unambiguous answer. 

As an illustration, solution of a classification item typically requires fewer 
executions of iriiereiice, rule assembly, and comparison processes than the ma- 
•ii v usk where both row and column rules must be inferred, assembled, and 
compared, and both sets oi information must be held in memory. Al a general 
level, successful performance in any rule induction task requires that the 
individual understand the constraints of the task and that those constraints serve 
as a sighiticaru component of the individual's problem space for the task. Dil- 
icieiices among tasks, and among items within a task, can arise in part from the 
number and type ol constraints that have to be met tor problem solution. 

The preceding general discussion of inductive reasoning tasks is intended as 
an overv iew of the psychological processes demanded by this set of tasks and the 
analytic issues thai heed to be addressed; What follows is a discussion of theoret- 
ical models of analogical reasoning; Because analogical reasoning items appear 
in different content forms and involve a sufficiently large set of constraints, 
understanding this task should contribute to a general understanding of processes 
involved ni this pervasive form of aptitude lest task. 
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IV THEORETICAL ANALYSES OF ANALOGICAL 
REASONING PERFORMANCE 



A: Overview of Previous Theories 

One of the earliest "process" theories of analogical reason.ng was formulated by 
Sarmt .923): According to Spearman, una.og.ca. reasomng mvolves three 
pESes First, one must -apprehend" or encode and understand the elements 
o the uem. The second process involves the - eduction" of the relate between 
me first two terms of the analogy. The third process is the "eduction of corre- 
late! "in which one uses the relationship inferred between the t.rst two terms 
together with the third term to find the solution to the item. Unfortunately, given 
the psychology of the time, Spearman's description of these processes was not 

u £entlv well specified to lead to direct experimental tests. In add.t.on, there 
^ implicit in K&^Hntion an automaticity of function that fa.ls to capture 
some of the apparent difficulty associated with solv.ng many analogy .terns. 

The process theory sketched out by Spearman has been greatly expanded and 
refined I the work of Sternberg ( '^7). Like Spearman, Sternb^ghas^po^ed 
a theory that is intended to apply across all analog.cal reason.ng tasks. The 
component processes in Sternberg's theory include: (1) encod.ng the .nd.v.dual 

eZ o> the analogy; (2, in.ernng the relationship between the t.rst two terms; 
rCapp ngthe rcla ionsh.p between the first and third terms; (4) applymg the 

e u s ^ the inference and mapping processes to the third term to generate an 

dea ounh term that is then used as the basis for evaluat.ng the alternate 

pecking operations performed on various types of informat.on such as verba 
numerical aS figural stimuli. We will have considerably more to say about h s 
subsequently The second direction is to elaborate a performance theory tha 

xplStlFconsiders a much wider range of both item difficulty and .nd.v.dual 

of Sarih that we have undertaken over the past few years: W.th.n th.s program 

is 
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we have conducted studies that systematically examined performance in analogy 
tasks as ii function of (I) content (figurai, numerical, and verbal), (2) iterii 
Llitlicuity, and (3) age and ability level. Latency, error, and protocol data, repre- 
seritmg the performance of different age and skill groups in different content 
areas, has led to the development of a theory of performance in multiple-choice 
and forced-choice analogical reasoning tasks that relates directly to general 
theories of problem solving (e.g., Newell & Simon, 1972) arid more specific 
theories of analogical reasoning, (e.g., Sternberg, 1977). 

B. Elements of a Problem-solving theory of 
Performance 

Hf tec live analogy solution behavior can be described as a series of steps toward 
satistaclion of a very specific and highly constrained goal: that of selecting a 
completion term from a set of options such that the C-D' relation is matched with 
the A-B relation and is more closely matched than any of the other alternative 
C-b relations Satisfaction of this goal requires satisfaction of implicit subgoals 
through use of three major sets of processes— relational inference (induction ot 
structure) relational comparison (feature matching), and relative match compari- 
son (discrimination among complex stimuli) (Heller, 1979): Execution of these 
pioccsses saiisties necessary subgoals of the general or top goal stated earlier. It 
is necessary to identify two relations, to establish the degree of their corre- 
spondence or match, arid io determine that the correspondence is greater than 
alternative matches. A complete process model consists of various sequences ot 
processes by which these goals can be satisfied. The operation of these processes 
can be described as outlined in the following. 

i: Relational Inference. Problem elements, i.e., the A and B terms of an 
item and their subparts, must first be encoded before a search for relations 
between problem elements is conducted. Then , in the case of verbal stimuli, 
information in semantic memory about features that link the A and B concepts is 
examined. In the case of numerical stimuli, an operation and a value are applied 
to one element (A) to produce the other element (B): Such information may be 
directly retrieved or computed. In the case of figurai stimuli, spatial, logical, or 
numerical transformations are sought that change elements in A into their corre- 
sponding form in B. As relational links among elements are discovered or ver- 
ified, the solver can be said to construct a cognitive representation of the ele- 
ments and relations. The latency and accuracy of this representation will be a 
function of the thoroughness of the search and the extent of an individual's 
declarative knowledge. Representations may be changed during the course of 
solution either by adding or deleting item features or by discarding the entire 
structure from consideration and constructing a new representation. Repre- 
sentations of relational features must be constructed for the A-B pair arid for each 
available C- D pair: 
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- Relational Comparison. This can be described as a feature matching 
process The outcome of relational comparison is a decision that relat.ons either 
Ltd. or do not match: Given that representations of two relations have been 
constructed features in both relations must be compared systemat.cally to deter- 
mine correspondence across representations. The goal Of execarmg relational 
comparison is to determine whether relations correspond and the degree of corre- 
spondence. To conclude that two relations are analogous, the solver needs to 
identify a sufficient number of matching features; the criterion number or degree 
of correspondence may vary across individuals, or across items lor each indi- 
vidual {This process leads to final decision in true-false verification type tasks.) 
The latency and accuracy of decision will be a function of the completeness ot 
the relationship representations and the thoroughness of feature matching pro- 
cesses i e whether a sufficient number of features are present in the repre- 
sentations and whether they are compared as exhaustively as necessary. In the 
case of complex rules or relational structures, the feature matching process may 
produce an incorrect evaluation due to loss or degradation of information in 



working memory. 



i Relative Mun h Comparison. This can be described as an optional dis- 
crimination process. Given tha! two or more relations have been judged to be 
Uigned with a referent relationship, a comparison of the.r relative match is 
performed to determine the one closest to the referent. Conversely, if matches 
have not been found, the alternatives must be re-examined to determine wh.ch 
relation comes closest to matching the referent relation. Essentially, d.scnrmna- 
nons must be made among alternative relations in order to select a best choice. 

The outcome of match comparison processes is a decision to accept one option 
on the basis of the greatest degree of alignment with the referent relationship. 
The accuracy of this decision will be a function of the accuracy and completeness 
of representational and relational comparison processes ill addition to the 
ihorbughness with which feature matches are compared. When processes do not 
y ,eld definitive outcomes, i.e., when subgoals are hot sat.st.ed. additional sc- 
iences of processes must be invoked. These activities include re-execution of 
relation identification processes when relational comparison or match compari- 
.on is indefinite. In some cases where the initial relation identification process 
tails the siibgoai of identifying the A-B relation must be satisfied m some way 
ibrYhe analogical top goal to be reached. As a result, the search or an A-B 
relation continues throughout option examination. Relationship identit.cat.on 
processes are executed for each C-D pair. Each C-D relation is then considered 
in conjunction with the A and B terms to determine whether ,1 : is applicable. If a 
representation of the A-B relation is constructed as a result of this process, the 
usual processes continue through to solution: 

If no A-B relation is identified, then the analogical top goal must be sus- 
pended and relationship identification processes are relied upon to identity any 
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B I) features that could aid in selecting the most likely completion term. How- 
ever, this docs not actrjalh satisfy the goals of either identifying two relations, 
establishing that the relations are aligned, or selecting a completion term that 
results m the two most closely aligned relations. Similarly, it match comparison 
processes do not yield a clear determination of the most closely matched relation, 
and no further relationship modifications can be determined, then final option 
selection must be arbitrary In these cases, the subgoal of identifying the best 
possible match has not been saiislied. 

Oar discussion of the processes required for analogy solution has implicitly 
represented performance in terms of ah "infer-infer-compare" solution proce- 
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FIG. 5.2. Flow diagram ot conceptually driven solution sequence. 
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FIG. 5.3. Flow diagram of possible interactive solution sequences. 
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dure That is, iih A : B relation is identified, and each C-D relation is identified 
and complied agaihsi iHe A -B relation Additional processing to achieve solu- 
tion includes relative mulch comparison, modifications , ot A-B or C-D relations 
by execution ot repealed relationship identification processes, and processing to 
ideiuitN die A - B relation after an initial failure to do so. In our data, it was found 
thai these processes are often executed repeatedly within a single solution epi- 
sode When a goal is not satisfied, it can be pursued through iterative or alterna- 
tive sequences of processes - 

Two general t>pcs of analogical solution sequences have been identified. In 
■•concepiuallv dm en' solutions, the A-B relation is initially identified, each 
opKiii i-. evaluated by comparison ot relations, and one completion term is 
selectt il Without revision or modification of the initially identified rule. A general 
!iov> diagiaui tor conceptually driven solutions is shown in Fig. 5.?. This particu- 
lar M.luiion sequence is representative of performance on easy and unambiguous 
iiciii-. vslieie there is little problem in identifying an A-B rule, and the informa- 
tion m die original rule specification is sufficient to discriminate among the 
available options Thus, lit no point during the course of solution is there a 
pioblem m saiist>iiig any of the necessary subgoais. 

The second genciai type of solution sequence is 'interactive," where ideri- 
iitication or mOdit ication of the analogical rule or A-B relation is a result ot 
mtomiation obtained in the set of completion terms. Thai is, whether or not a rule 
v^is niuiallS identified, identification ot C-D relations cues recognition of alter- 
iiiiiiU- A B relations, in Kg. 5.3, the additional processes required for interac- 
tive solutions have been added to the flow diagram for conceptually driven 
solutions; and thus the figure represents the many possible analogy solution 
sequences that may be observed. The additional components of the model are a 
tuiiciion o) die interactive and recursive nature of solution in cases where there is 
a failure to .initially satisfy the goal of identifying an A-B relation, or a failure to 
achieve matching relations because of an inappropriate or incomplete A-B rela- 
tionship. T he representation in Fig: 5:3 is intended to reflect performance on a 
broad range of item difficulty. In fact, easy items tend to evoke coriceptually- 
driven solutions, while difficult items often require complex arid interactive 
solution sequences. We will discuss this in more detail in the section on verbal 
analogy performance. 



V. COMPONENTS OF FIGURAL ANALOGY SOLUTION 



A; Overview 

This is the first of three sections that discuss data arid theory on the processing of 
specific types of analogies. We discuss figural analogies first because it is easier 
to describe and analyze the type of item features in these problems; in contrast to 
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the symbolic aspects of numerical and verbal analogies, the information neces- 
sary tor item solution is externally represented in the physical problem array. The 
elements of a figural analogy are directly represented in. the figures 7 or patterns 
shown and the relational rules are based upon spatial and logical transformations 
of these physical features; 

in the foregoing section on theories of analogy, we provided an overview of 
the components of a generalized solution model tor all analogy tasks. The pur- 
pose of this section is to relate the specific task of solving figural analogies to that 
n u>re general theory. Our goal is to show how the general theory can be instan- 
tiated in the form of piocess models for the solution of a specific item type. We 
will first review relevant models of figural analogy solution that attempt to rekKe 
item features to cognitive processing activities and thai provide a skeletal model 
lor item lealuie processing. We then discuss data relevant to such a model and 
attempt to link together data and theory on item features, response latency, and 
errors in ri theory of performance in figural analogy tasks. 



B. Problem features and Processing Models 

As noted earlier, Sternberg (1977) lias provided a general theory of analogy 
solution that is applicable to the solution of figjral analogies; A detailed speciti- 
c "it ion of the representational and processing assumptions necessary tor the solu- 
tion of ficurai analogies has also been provided by Evans (1968). His theory is 
embodied m a computer program thai was intended as an aniticia! intelligence 
anal> sis of task requirements. It was not, however, mtended as a theory ot 
human performance. Evans' model represents an "inter-inter-compare ' solution 
procedure consistent with our earlier theory discussion. In Evans' theory, the 
major processes can be described as (I) pattern comparison and decomposition 
(encodini: or representation). (2) rale generation and matching (relational in- 
ference and relational matching), and (3) rule discrimination (relative match 
comparison*, which is optional: The processes in Evans' theory are lied directly 
to basic aspects of item content: The specific aspects of item content are: (a) the 
individual elements used to construct the separate analogy tenns, and (b) the 
individual spatial and logical transformations applied to the elements to construct 
overall rules: The elements are easily perceived plane geometric figures such as 
luies. ciicles, triangles, and quadrilaterals:. The basic transformations include: 
ieihovmt: or adding elements; rotating, reflecting, arid displacing elements; size 
changesfand variations in element shading. The relationship between item con- 
tent and processing operation is illustrated in Fig. 5.4, which shows a simplified 
process model for the verification of the truth or falsity of a completed analogy. 
As shown in the model, we assume that there is an initial pattern comparison and 
decomposition process that yields units of information that represent the indi- 
vidual elements involved in a pair of analogy terms. The time to execute such a 
process should be a function of ihe number of elements or dimensions that must 
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PROCESS 



PRODUCT 



Pattern comparison and 
decomposition of 
A and B 



Element List (geometric 
patterns; lines, etc;) 



RTi =eE 



Transformatjon analysis 
and rule generation for 

_ A--B 



Elemerit-trarisfbrmatibh 
List (object •operation 
propos lions) 



RTn - tT 



Pattern comparison ana 
decomposition of 
C and D 



Element List 



RT 3 = eE 



Transformation analysis 
and rule generation for 

C-D 



Element-transformation List 



RT 4 - tT 



Ru 



le Lornpdnson 



RT 5 = cT 



RT total axE ^ T + k 

FIG: U 5:4; Siriiplit'ied piiHrcss model tor figuraj analogy verification task. From 
C nmrHin^nu ol Geometric Analogy Soiuhon by T M. Mulhollan_d\ J W 
l-eiiegnno; and K. CJla>cr, Capita ? rsyi holoi>\. 1980, 12. 252-284. Copyrighl 
l^hd b> Academic Pros, Reprinted by permission. 



be isolated. Thus, as shown in Fig. 5.4, the total time for this initial stage of 
processing {RT t j is the product of the average time to represent a single element 
UO and the total number of elements (£) to be represented. 

The second stage of processing involves transformation analysis arid rule 
generation. This phase of processing attempts to determine the transformations 
(operations) thai specify the rale for changing the A stimulus into the B stimulus, 
The outcome of such a process is assumed to be a prepositional list in working 
memory that represents element-transformation pairs, i.e., an object -ope ration 
list. The tiriie to identify and order a set of transformations should be a direct 
function of the number of transformations involved in an item. The total time for 
this second stage of processing {RT.) is the product of the average time for a 
single transformation (?) and the total number of transformations (T). 
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The two components of processing, ( I ) pattern comparison-decomposiuon t 
and (2) transformation analysis-rale generation, occur more than once, since 
analogies contain two separate parrs of terms. They are followed by a final 
process involving rale comparison or matching in which the propositiona! lists 
are compared to determine if there is equality or correspondence of rules. This 
process should also be a function of the number of transformations that describe 
the rule for a specific hem. Thus, the total time for solution of the analogy 
verification task should be the combination of the separate times for the indi- 
vidual processing stages. This can be reduced to the following simple expression: 
RT = xh + yt + k. This assumption about item representation arid processing 
was tested in an experiment that systematically varied item content (Mulholland 
et a!., 1980); The outcomes of that experiment and the implications for more 
specific processing issues are summarized in the next section. 



C. Data and Theory on Item Processing 

in the study conducted by Mulholland et al, (1980), a set of analogies was 
constructed in which the number and type of elements and transformations were 
systematically varied across items. The items were presented in a true-false 
verification format, and latency data were used to evaluate the hypothesized 
processing model shown in Fig. 5.4. The analogies used were generated from six 
types of elements and six types of transformations that frequently occur in items 
found on aptitude tests. Figure 5.5 gives some examples of the types of true and 
false items. The true items had from one to three elements in each analogy term, 
and the rules were based on zero to three transformations of the elements in the 
analogy terms. Items were made false by adding incorrect element information or 
by replacing correct transformations with incorrect ones in the C-D pair. The 
items were presented to 28 undergraduates who had been previously adminis- 
tered a standardized test consisting of 25 multiple-choice items (see Mulholland 
ei al 1980, for additional procedural details). 

[. Processing True Analogies. Verification of the truth of an analogy re- 
quires exhaustive search of all the element and transformation information in the 
A-B arid C-D pair of terms: Thus, as shown in Fig. 5.4, the time to solution 
should be a monotonic function of increases in the structural complexity of items. 
The important issue in this regard is the absolute and relative amount of time that 
is associated with element versus transformation processing and whether the 
effects of these two factors are independent and additive, as represented in the 
model, or interactive. The basic reaction time data are shown in Fig. 5.6. In- 
creasing the number of elements systematically increased the time to solution as 
predicted. This suggests that the patterns comprising the terms of the analogies 
were decomposed element by element as hypothesized. The rate of processing 
elements was nearly constant (additive) within each transformation condition. 
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but it varied as a function of the total number of transformations. Likewise, 
transfonnations appear to have been processed in a serial fashion as solution 
proceeded additively within each number of elements condition, but increasing in 
tiiiie per transformation with increases in the number of elements. 

The data shown in Fig. 5.6 are generally consistent with the model shown 
earlier, but the interaction of element and transformation processing was riot 
predicted. The predicted points shown in Fig. 5.6 are based upon the following 
function, which accounted for 97% of the variance in the group mean data: 
tfAmsec) = 4257' + 358£ + 7577: + 797. Our explanation for the violation of 
simple additivity is in terms of capacity or resource limits in item processing. As 
item complexity increases, there is a problem of mental bookkeeping that will 
begin to draw upon a limited capacity processing system. Each operation per- 
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FIG. 5.6. Mean reaction time lor true analogies as a function of elements and 
transformations. From "Components of Geometric Analogy Solution" by T. M 
MulhoIIariU. 3 W: Pellegrino. and R. Glaser. Co^mttvr /Vu hutugy. 1980. /2. 
252-284. Copyright 1980 by Academic Press. Reprinted by permission. 
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tori nc U in decomposing patterns arid idcnlitying transfoimatiohs in the analogy 
tcfihs > ieids units ol information thai require space In a working memory system. 
As iiioie partial iritofniaiioh is accumulated and entered inio working memory, 
one iiuS begin to approach the limits of this system When this occurs, prccess- 
ihg tune and ct tort may have to be deployed in the service ot updating and 
inaiiilaihing the contents ol working memory. Note that the overall solution limes 
Vars oser n range ot seconds; requiring that solution information be available in 
meniorv and not become degraded tor more than just a brief period. 

tiiven these assumptions and data, we argue that the processes involved in 
pattern com pari m n-decomposilion and transformation analysis-rule generation 
can be considered to be essentially additive, but the factor of memory load, 
winch increases at a nonlinear rate, produces the increasingly longer times for 
complex items. When extrapolated to even more complex items than those used 
in tins study, the mental bookkeeping operations become more apparent arid may 
well lake up the largest share of lime. As both elements arid transformations 
increase, solution may require substantial external memory lhat is not available, 
thereby creating a need tor alternative processing strategies that are time consum- 
ing and icquire a considerable amount of conscious control arid monitoring. This 
would represent a shift in the proportion of the total solution time thai goes to the 
actual processing operations as compared lb thai required tor information man- 
agement 

2 /V<>u \.w//y f \tl.\c Anitlt>xu'\. In order to discuss pertornlance on false 
analogies, it is necessary to elaborate the model shown in Fig: 5.4 to incorporate 
^presentational and processing assumptions about element and transformation 
features. Figure 5.7 shows a more detailed model thai is intended to represent 
assumptions such as the sequential arid self-lerminaling processing of element 
and transtormatiori features. The leftmost section of Fig: 5.7 represenis the 
processing ol elements and transfonnations in ihe A-B pair of terms. The middle 
section of the figure represents ihe components of C-D processing and overall 
rule comparison. This section of the model incorporates a self-terminating pro- 
cessing strategy, since iii contrast to irae items, it is possible to terminate pro- 
cessing of false items al the point where incorrect information is first detected. 

The data on false item processing clearly supported a model incorporating a 
self-terminating solution procedure: The left panel of Fig. 5.8 shows ihe predic- 
tions based on this self-terminaling processing model in terms of the number of 
elements thai would be processed before each item type could be declared false. 
Items were made false by the replacement of correct elements in the C-D pair 
with incorrect ones. An exhaustive processing strategy would yield Hat functions 
for the ditterenl conditions shown in Fig. 5.8. The right panel of Fig. 5.8 shows 
the mean reaction lime for each type of incorrect element item. The data strongly 
support a model that assumes a strategy of process termination followed by 
response whenever incorrect element information is detected in the problem. 
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Fig 5.7, Expanded process model for figural analogy verification task. Adapted from "Com. 
penis of Geometric Analogy Solution" by T; M. Mulholland, J,W, Pellegrino, and R, Gteer, 
C^im M^r, 1980, II 252-284. Copyright 1980 by Academic Press. Repnnted by 

permission. 
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Element Changes in C D 

FIG. 5 8. Predicted arid ubserved perTomiahce oh analogies containing incorrect 
elemeiiiN Adapted I rum "Components pi' Geometric Analogy Soiuiion" by T. M. 
MtiUuiMand. J W" Pellee.rim>, and K Glaser, Co^tiitiit- rsyiholoxy, 1980, 12, 
2^1 2«4 L\ip>rigiu i»Jhti b> AcadciiiiL Press. Reprinted by permission. 

A similar analysis of processing was possible Tor the items that were made 
false h> introducing incorrect transformation information. The upper panels of 
ritj 5.9 show the predictions for both self-terniihating and exhaustive processing 
strategies in terms of the number of transformations that would have to be 
processed to declare ah item false given its trarisTorrriaTibria^ structure. The bot- 
tom panels of Fig. 5.9 show the mean rejection time for each type of item. 
Again, the data support a serial self-terminating processing strategy over an 
e x riuli s t i v e p roc e s s i rig st rat egy . 

Thus, to summarize the data on item feature processing, it is clear that the 
major content components of figural analogy problems* are systematically pro- 
cessed in a mariner consistent with the detailed model shown in Fig^5:7. The 
overall strategy represents an efficient, self-terminating solution mode that 
allows for the rapid rejection of incorrect items: Although not discussedhere, the 
data also support a model in which element and transformation information is 
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FiG. 5.9. Prcdtcicd and observed pertormahce bh analogies containing incorreel 
ira^lbrmaUons. Adapted Irom "Componenb pt Geomeine Analogy Solution 1 ; by 
T. M. Mulholland, J. W. Pcllegrmo. arid R: Glaser, Cognitive Psychology. 1980, 
12, 252-284. Copyrighi 1 980 by Academic Press. Rcprinicd by permission. 

processed in a pairwise sequential manner, with element information being pro- 
cessed before transformation information; 



D; Item Features, Errors, and Performance 

As in the case of latency data, theoretical assumptions about feature processing 
can be related to the error data to contribute to an overall theory of performance. 
The critical error data are shown in Fig. 5.10, which represents performance on 
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the true items. The error data clearly show thai ihe major fa.ior leading lo 
veriUcaiion errors involves [he transformations thai serve lo define ihe rule for ah 
ileiti There appears ici be two ways in which increases in rule eomplexiiy 
liranstormauonaj compiexii)) lead lo increased errors. In ihe iwo and three 
element Hems; where transformations are mapped one-to-one onto individual 
elements; the data show an independence and addilivily of error probabililies 
associated with ihe separately iranslormed elemenis. In such ca^es, ihe increased 
error rate on more complex problems can be understood in ierms of a simple 
accumulation of independent, meorrccl representaiions of iransformed elemenis, 
an> one of which could lead lo an overall incorrect response. For mosl adults this 
error rate should be low, particularly given ihe types of transformation used by 
Ntuihoilaiid, et a! 

1 he oilier was that rule complexity a f fee is error rale is when multiple trans- 
torhidiiohs i>i a snit'le elemenl are required. The probabilily of this lype of error is 
much laijiei. aiul u may be due lo ihe amount of mfonlialion lhat musi be 
retained in working mcmor> Assuming thai each transformation applied to an 
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FIG. 5.10. Predicted and observed error rates for true analogies. Adapted from 
"Component* oi Geometric Analogy Solution by T. M. Mulholland. J- W. 
Pcllc^nno. and R Glaser. Co^nitne Psychology. 1980, 12, 252-284. Copyright 
ivwi K> Ac.idciiiic Press Reprinted by permission. 
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element ; quires at least one placekeepcr in working memory (sec Kolovsky & 
Simon, 1 "s» / 3 > ; an item with two transformations of the iame eleilieiil will require 
ai least two and possibly, ihrcc memory plaLekeepers, since the order or sequence 
of applying transformations may constitute a third component of rate informa- 
tion. Additionally, in the one lenient multiple-transformation case, testing and 
memory must be internal tor all but the final product of the application of several 
transformations. Thus, an additional memory placekeepcr would be required for 
storing the intermediate products of solution processes during the evaluation of 
the C-D pair. These intermediate products that have to be stored, in addition to 
the other record keeping required, tend to further tax memory capacity, thereby 
increasing error. 

Memory load problems and loss of information can also occur in items with 
several separately transformed elements. This assumption, along with those 
specified in the preceding, was used to derive the following general function for 
error probability: terror) = 1 - ( I -£*)'( 1 -X- M x ) where: 
a - the probability of incorrectly representing or applying a given transforma- 
tion 

T _ ihc total number of transformations that determine the rule for an item 
A - the limit or maximum amount of information that Can be held in working 

memory _ ..... 

M = the number of memory placekeepers required during the solution 

This function was used to fit the data in Fig. 5 .10 with best fitting values of a 
equal to .044 and A equal to 5.8. The predicted values from the best fit are shown 
in Fig: 5.10 and the R* for the fit between observed and predicted was .93. The 
v alue of a is low as would be expected given that it represents the probability of 
misrepresenting or misapplying a simple spatial or logical transformation. The 
value of A is quite clu.e fo the magical number 7 that is often cited as the capacity 
limit of shon-lerm or working memory. Although the specific value of A may 
vary for a group or an individual, the function described above captures the fact 
that the probability of information loss, and thus problem error, increases very 
rapidly as one approaches the limits of working memory. Thus, the true item 
latency and error data suggested that working memory factors associated with the 
representation and management of item features appear to provide the basis for 
nonaddiiive increases in solution latency as well as significant increases in the 
probability of error for certain levels of transformational complexity. 

The analysis of the relationships among item features, solution latency, error 
rales, and pressing models supports a general theory of figural analogy solu- 
tion thai can be summarized in terms of assumptions about processing, repre- 
sentation, arid memory storage: In the first phase of processing, the A arid B 
terms of the analogy are globally encoded, and the two internal representations 
are compared lb determine specific elements or subpallerns common to both 
items. This process may be viewed as parsing the figure arid determining the 
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niDsi appropriate level of element representation. Such a pattern comparison- 
deebmpbsmbri piocess is necessary since there lire often multiple representations 
b! patterns, arid Hie ielevan' attributes of a figure can only be a^-irtained in the 
presence of a comparison stimulus. The relevance of an attribute is determined 
by a irarislonnation as represented by the B term, which creates an encoding 

" context tor the problem The comparison-decomposition process provides the 
basic information necessary for the execution of the subsequent inference and 
rule generation process during which the precise trarisfbrrnatibri(s) applied to 
each element or subpatteni is determined. This process attempts to define ah 
operation that is capable of changing an element in A into its corresponding form 
in B the mtcrence and rule generation process is assumed to be exhaustive for 
all the elements in the A-B pair. The outcome of the inference arid rule geriera- 
iioii process can be conceived of as an object-operation list, i.e., a propositional 
list: stored in working memory. This list provides the basis for evaluating the 
t D hall of the item. 

The next major phase of processing also involves encoding, pattern compari- 
son, decomposition; and inference processes, and, in addition, a rule comparison 
process The C and D terms must be encoded and then decomposed into basic 
elements that correspond to those specified for A arid B. If a basic element of C is 
not present in D. then processing terminates arid the item is declared false. If an 
element is present, but the interred transformation does not match the value 
\iored in memory, then processing terminates arid the item is declared false. In 
the event ui a successful match, a new element-transformation pairing is tested 
and this continues until no further elements remain to be considered. At this 
point, the item is declared true. This description of processing is consistent with 
all the latency data for the true and false items obtained for adults (Mulholland et 
al.. 19X0) arid children (Bisanz, 1979). 

The general processing assumptions described in the preceding are also con- 
sistent with the error rates associated with certain item structure manipulations. 
The largest single source of error was multiple transformations of single ele- 
ments if the preceding model is applied in this case, then the intermediate results 
of the C-D inference process must be retained in memory and the entire trans- 
formation sequence inferred before the truth value of the D term can be judged. 
Thus, additional demands on working memory may cause some of the original 
eleMient-trattsfonnation information to be lost or degraded. 

Within the theory, it is assumed that each operation associated with pattern 
decomposition and transformation analysis of an A-B pair yields a unit of infor- 

*> iiiation that needs to be stored in working memory. The information can be 
conceived of as a list of element-transformation or object-operation propositions, 
as in the Simon and Kotovsky (1963) notational system for series problems (see 
also Rumelhart. 1977). As the number of transformations in a figural analogy 
problem increases, the load on working memory can become substantial and give 
rise to errors. Increases in memory load may also require the individual to 
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allocate substantial processing resources to activities designed to avoid or reduce 
information loss. Young children (Bisanz, 1979) and less proficient solvers may 
be particularly inefficient in these aspects of pertormarice ii is important to note 
that the memory load explanation has been verified by empirical studies of 
performance on series extrapolation problems (e.g., Holzmari, el a!., 1976; 
Kolovsky & Simon, 1973). A similar set of representational, proeessing, arid 
working memory' assumptions may also be applicable to performance differences 
across items on figural matrix problems from the Raven's Progressive Matrices 
Test (e.g., see Hunt's, 1974, analysis of this task). 

VI. COMPONENTS OF NUMERICAL ANALOGY 
SOLUTION 

A. Overview 

In our preceding discussion of figural analogy solution, we largely ignored the 
issue of the declarative knowledge base necessary for solving such problems— 
the elements ot figural problems are readily identified patterns that can be pre- 
sumed to have some universality over individuals arid, perhaps, cultures: The 
solution of numerical analogy problems, however, requires a consideration of the 
knowledge base neeessary to represent both the individual numerical stimuli and 
the relations between pairs of numbers. Sueh knowledge is variable across indi- 
viduals of the same age, depending on their background and experiences, and it 
is high!) variable aeross age groups. In addition, the organization of this knowl- 
edge inay differentially affect performance across individuals and age groups. 

Tri numerical analogy problems, there are also a variety of simple and complex 
relations between pairs of numbers thai introduce a problem of representational 
variability or ambiguity in the analogical rule. Consider for example the pair 
2 16, which can be represented as having several relationships, e.g., r 14, xK, 
or 2*. Contrast this with the pair 2:15. whieh can be simply represented as +13. 
ii is beeause of such possibilities, which relate directly to both the information 
represented in semantic memory and the way in which that information is acces- 
sed, that the multiple relational features of sueh problems require a careful 
analysis arid must be accommodated in any process model arid performance 
theory. 

In this section, we will first present an analysis of problem features as related 
to a general process model for task performance. This serves as the context for 
our discussion of data and'theory on item feature proeessing. The results are then 
related to assumptions about the storage and retrieval of quantitative information 
in permanent memory Finally, we will consider the relationships among item 
features, errors, and performance theories. One aspect of our analysis of these 
relationships will be aspects of developmental changes in perf ormance and their 
apparent relationship to ehanges in knowledge structures as a function ot age and 
schooling: 
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B. Problem Features and Processing Models 

Numerical analogy solution has hot been the subject of any intensive empirical 
analyses or artificial intelligence theories. It is possible, however, to use our 
previously .staled theory of analogy solution as the basis for describing a process- 
ing model of the ihfer-infer-compare type and apply it to the case of numerical 
analogies with the form A:B :: C:D :: E: ~ ~ ~ As we illustrated earlier, 
numerical analogies require two number pairs to specify and disambiguate the 
rule lor the item: In the prototype format shown here, this rule is then applied 
to another number to complete the third pair: Figure 5.11 (ignoring the loop, 
winch will he discussed later) is a simplified process model for solution of 
problems of this type. As shown in the model, the A and B terms must be 
encoded and an inference must be made about the rule that relates the two 
members ol the pair. This rule is an operation or set of operations and a specific 
value lor each operation, e.g.. for the pair 2:5 it would be +3. 

The next major phase of processing involves similar encoding and relational 
inference processes for fhe C:D pair. 'Phis stage of processing can be coritextually 
insensitive: The type and \alue of the A-B relationship will hot influence the 
iiitereiiee process tor fhe C- I) pair. Or. the process caii be a contextually serisi : 
live or guided one thai attempts to evaluate the applicability of the A-B relational 
iiiioriiiatioii lor the CD pair. In either case, the outcome of this stage of process- 
ing is a match or mismatch of relational information or rules. In the case of a 
match, the rule can be applied to the E term to generate a response (i.e. , a 
conceptually dri\en solution). In the case of a mismatching relationship, the 
inference process has to He re : e.\eeuied for either or both the A-B and C-D pairs 
and another attempt has to be made to match information to find an acceptable 
rule ti e . ah interactive solution). The various possibilities for the case of 
mismatching relationships v\il! be developed later in more detail: 

The processing model provides a basis for considering the problem features 
that inflaenec solution and the locus of their effect. Unlike figural analogies, the 
terms of rumieneai analogies are individual whole numbers and they are not 
composites of separate elements; Thus; the elements of the problem are 
straightforward and their encoding involves activation of conceptual knowledge 
about the properties ol the panieualr clement: odd-even, prime, perfect square, 
etc. 

The most critical feature of numerical analogy problems involves the relation- 
ships governing trie problem as a whole and the possible relational information 
associated with the A-B and C-D pairs. It is possible to have problems where the 
overall rule is addition, but that differ in terms of other relational information that 
may affect solution. Consider two problems: In the problem 4:9 :: 7:12 :: 

2. the rule is +5 and no other simple relational information is present to 

influence solution. Thus, the solution of such ah item should involve a 
straightforward, conceptually guided solution as shown in Fig. 5. N . Contrast the 
solution of the following problem with the one above: 6:30 :: 3:27 :: 2: 
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FIG. 5:11. Simplified process model for numerical analogy task. 
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The rule i.s -i 24 but there is oilier simple relational information in both the A-B 
arul C- D pairs The influence of such information on solution can be tninimai or 
suhsiaiiii.il depending on the organization and aatomauciiy of retrieval of certain 
IS pes ol leiiitionai know ledge Thus; it is very likely that the information about 
multiplicative relationships \h x 5 - 30 and 3x9 - 27) will influence either or 
both i he A- B and C I) relational inference process and lead to more difficult and 
complex solutions ot the interactive type. 

When there are several simple relations in both the A-B and C-D pairs, the 
organisation and atnomaticny of retrieval of certain types of simple rciationai 
knowledge- aticct item difficulty. Similarly, problems with either a low 
salience (e g : powers: roots, proportions) or compound rule (e.g., x2 + 3) will 
also be more diiiicult to solve since there are a variety of simple types of 
relationships that ate hkels to be inferred, evaluated, and rejected prior to cbh- 
sidcting i elation ships such as cubes, cube roots, rioninteger multiplication, or 
vompotim! luies. I iiesc t\pes of problems are not curiosities but represent actual 
manipulations oi problem I e at u res on tests. Thus ah imponant feature of riu : 
merle ai aiiaiog\ ptoMems is the type of relational knowledge required for solu- 
tion ami the numlici: s;\juence, and locus of processing operations involved in 
identii\nig «>r accessing th.it information. 

1 'lie pieceding issues about item features, information retrieval, and process- 
ing components svltc addressed in a studv that presented simple analogy prob 
ieiiis to col Leu students oi high and low aptitude. In this study, the testing format 
iiiaiie it possible to deiive separate latency estimates lor each phase of processing 
(I'ellegriho. L'hi, & Majeiic, Note 2). Table 5:4 shows the procedure for succes- 
sive i> adding problem information and obtaining separate latencies during each 
phase ol pioCessiiig The problems represented a variety of possible relationship 

Table 5.4 

Incremental Procedure for Presenting Numerical Analogy Problems 



Stimuli Response Latenc y Compo nents 



Phase I 4:7 Button press Encoding + 

indicating Relational Inference 
inference of 
a relation 

Phase n 4:7 8.11 Button press Encoding + 

indicating Relational Inference + 

determination Relational Comparison 

of problem rule (+ additional inference) 



Phase IU 4 7 : : 8:11 :: 15 _ Keyboard responce Encoding + 

indicating first Relational Application 

digit of response 
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types and values and allowed us to test assumptions about the order of accessing 
information ill lemory and the role of such information in subsequent phases of 
processing. 

C. Data arid Theory on item Feature Processing 

Problems were classified in terms of the global processing sequence governing 
solution, i.e.. conceptually driven versus interactive solutions. For problems 
involving a conceptually driven solution, the initial relational inference for the 
A-B pair was applicable to the C-D pair, allowing the individual to move rapidly 
to the final application stage of solution. For problems with interactive .solutions, 
the overall relation governing the problem was not immediately accessible due to 
the presence of more salient or competing relational information in the A- B or 
C-D pairs of terms. We will consider performance on these two general classes 
of problems separately to illustrate different points about item feature processing 
and knowledge retrieval. We will also focus on differences in the college sample 
that was tested. The 16 subjects were divided into a high and low aptitude group 
based upon SAT scores, the high group having an average score ot 675 and the 
low group an average of 524. 

1 Conceptually Driven Solutions. Table 5.5 shows the type of interred 
relationships in the problems with conceptually driven solutions. Successful 
performance on problems of this type requires an available quantitative knowl- 
edge base that contains either direct declarative knowledge of speciiic interrela- 
tionships between pairs of numbers, or procedures for determining values and 
types of relationships that may exist. We have assumed that the necessary decla- 
rative and procedural knowledge is available in the college student sample and 
that simple problems of this type will not pose any major difficulty, However, 
there may be systematic individual differences in the speed or performing the 
processing activities necessary for solution of even simple analogy problems. 

Problems requiring conceptually driven solutions had high levels of accuracy 
in both skill groups. In Fig. 5.12. the similarities and differences between skill 

Table 5.5 

Examples of Problems Generally Resulting in Conceptually Dr iven Solutions 



Problem Type . Example 

Simple Addition (single integer) 
Complex Addition (multiple integer) 
Simple Multiplication (single integer) 
Complex Multiplication (multiple integer) 
Squares (single int eger) 
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FIG. 5:12. Mean solution latencies for skilled and less-skilled individuals as 
junction ol pha»e of piocessing and lype of relationship. 
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groups over all three phases of processing can be examined. The top panel shows 
initial inference latency for the different relational types. As can be seen, there 
were highly systematic and significant differences in initial inference latency 
both within and between types of relationships. Furthermore, the skill groups did 
not differ in either the pattern of problem differences or overall latency. The 
middle panel of Fig. 5.12 shows the data for the second phase of processing. 
Again, there were highly systematic and significant differences in the second 
stage evaluation latency both within and across types of relationships. While the 
skill groups did riot differ in the pattern of problem differences, there was an 
overall latency difference. For all problem conditions, the skilled group was 
faster during the second phase of processing. Coupled with the lack of a latency 
difference in the initial inference processing, this latter difference suggests the 
possibility that the skill groups may have differed in the precision of the inference 
curried over into the second phase of processing. The bottom panel of Fig. 5.12 
shows the data for the third phase of processing. There were systematic arid 
significant differences in the final application latency both within and across 
relationship types. In addition, skill groups differed significantly on problems 
requiring application of a multi-digit operation and successive application of two 
single digit operations as occurs in multiplication by fractions. 

Two general conclusions can he drawn from these data. First, there are sys- 
tematic problem differences in the speed with which certain types of quantitative 
relationships are inferred, evaluated, and applied in relatively simple analogy 
problems. Second, while skill differences do riot appear in the patterning ot 
problem differences during any of the three phases of processing, they are pre- 
sent in the speed of evaluating the relational overlap between two pairs ot 
numbers and the application oi relational information to generate final solutions. 

2. Interactive Solutions. The systematic latency differences both between 
arid within relationship types have important implications about the types of 
relational information that may be directly and automatically retrieved versos; 
those that are actually computed It seems reasonable to assume that the countless 
hours of practice on the multiplication tables plus the numerous times that these 
facts are used in everyday problem solving lead to a direct access and retrieval for 
multiplication relationships and that simple multiplication relationships can take 
precedence over addition; i.e., for the pair 4:28. It is possible to test this 
hypothesis by creating potentially garden path analogies of the type shown in 
Table 5.6. Such garden path problems should lead to interactive solutions it 
multiplication is the preferred inference for such number pairs. The three dif- 
ferent problem types labeled A-I to A-III represent cases where a simple multi- 
plication inference is poss^le sometime during the coarse of solution. The prob- 
lems differ in whether a uch a relationship can be inferred in the second, hrst, or 
both pairs. 

The data of interest are latencies during the second stage evaluation tor prob- 
lems where the correct rule is multi-digit addition, hot where one or both pairs 
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Table, 5.6 

Examples of Problems Generally Resulting in Interactive Solutions 
'rbbleiri Types Relational Inferences Examples 

Role = Complex Addition 

A I A: B is Complex Addition 8:35 :: 3:30 :: 4: 

C:D is Simple Multiplication * 5:41 :: 9:45 :: 3: 

or Complex Addition 



Rule = Complex Addition 

Afl A:B is Simple Multiplication 3:17 :: 7:31 :: 2: 
or Complex Addition 

C:D is Complex Addition 7:42 :: 3:38 :: 4:, 



Rule = Complex Addition 
A 01 A: B is Simple Multiplication 6:30 :: 3:27 :: 2: 

or Complex Addition 
C:D is Simple Multiplication 10:40:: 6:36 :: 5: 

or Complex Addition 



Rule - Simple Multiplication 

Ml A B is Simple Multiplication 3:24 :: 8:64 :: 5 

C D is Square or 4:12 :: 3:9 :: 2 
Simple Multiplication 



Rule = Simple Multiplication 
MH A:B is Square or 5:25 :: 2:10 :: 4: 

Simple Multiplication 
C:D is Simple Multiplication 8:64 :: 4:32 :: 3: 



lave a possible simple multiplication inference: The left panel of Fig. 5.13 
ihows that, relative to the baseline addition problem, there is no interference 
tthen only the second pair involves a possible multiplication inference, i.e., 
problem type A-I: This suggests that second stage relational evaluation involves 
i eontextually directed process based upon the specific outcome of the first stage 
nterence process. Both skill groups showed interference effects when the first 
;>air involved a possible multiplication inference, i.e., problem type A-II. These 
nterterence effects are increased when there is a second pair that involves a 
Jittereni poviihic multiplication inference, i.e., problem type A-III. The less 
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FiG. 5.13. Mean Pha*e II Laicncy a.s a (unction of ^kill and problem type. 

skilled group shows a substantial increment in time for these problem types. The 
data for both groups, when coupled with the previous data on initial inference 
times, suggest that multiplicatiori has precedence over addition, at least within 
the range of simple multiplication values associated with the highly overlearned 
multiplication tables. The precedence is most likely a function of the direct or 
spontaneous retrieval of the stored relational information rather than any compu- 
tation process per se. _ 

li is also possible to examine the possibility that simple exponent relationships 
such as squares are directly retrievable and that such retrieval may take prece- 
dence over or coincide with the retrieval of simple multiplication relationships. 
Potential garden path or interactive solution problems of this type were also 
created and these are shown in Table 5.6, i.e., problem type M-1I. The right 
panel of Fig. 5:13 shows performance relative to a baseline multiplication prob- 
lem where an inference of an exponent relationship is not possible, resulting in a 
simple conceptually driven solution. As can be seen in the figure, both skill 
groups showed that there were no interference effects when the second number 
pair involved a possible conflicting relationship, i.e., problem type M-l relative 
to the baseline condition. This again supports a processing model where the 
second stage relational evaluation is directed by specific inferences resulting 
from the first stage of processing. Both skill groups show interference effects 
when the first pair may be represented as a square relationship. Additionally, the 
skilled individuals are faster overall in the evaluation of all multiplication prob- 
lems. 
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Thus, the data lor the second set of potentially garden path or interactive 
solution items siiggesi thai simple exponents lake precedence over simple multi- 
plication. Again tins may result from the direct representation arid spontaneous 
retrieval or this i\pc of information in the knowledge structure. Clearly, the 
knowledge luse sustains multiple representations ot relations that affect problem 
solution in the context of a model such as the one outlined earlier: Furthermore, it 
should be rioted thai overall pei'tbfniancc on the garden path or interactive solu- 
tion prohlehis show is thai skill differences appear in the speed of evaluating 
certain tv pes of relational information but not in the apparent order or precedence 
of encoding or inferring quantitative relationships; Such order differences would 
hot he expected given that college students have available all the multiplication 
tacts as well as the simple squares: However, skill differences appear in the 
speed and likelihood of successfully finding the addition rule in problems that 
capitalize on the encoding of multiplication relationships. 

A Una I class ot problems lor which skill differences might be expected are 
those wall relationships that are much less salient than squares and integer 
addition and multiplication, e.g.. multiplication by fractions and the use of cubes 
and tounil poweis l:\ainples ot these problems are provided in Table 5.7. In 
these piohtems; n is expected that multiplication or addition will be the initial 
iiilciencc Thus; the second stage of processing will require a search for alterna- 
tive ici an on ships, and skill ditterences may appear in both rhc time and success 
of such processing I able 7 shows that there were substantial skill differences 
ioi hotii evaluation latencv and application latency for the noriihteger muliiplica- 
non problems, liven larger difteiences were obtained when the problems in- 
volved cubes or lourth powers, and there were subslarilial accuracy differences; 
on these problems well. 

.i (Unci a! l'toit'.winx MtntcU. The data that we have presented on the 
processing oi diti event lie in ivpes and skill differences in processing can be used 
io evaluate a iiiodci of the type shown earlier in Fig: 5.11. The major 



Tabje 5.7 

Skill DiftC*rC'r»ces in Pt}r formjnee for Problems Containing Low Salience Rules 



Problem Type 


Performance Measure 


Skilled 


Less-Skilled 


-Non ml eyer Mult ipliCdtidh 


Phase n latency . 


5:06 sec: 


10:25 sec 


14 21 .: 812 ■: 2 


Phase HI latencv 


2.38 sec. 


5.28 sec. 


12 16 : 9.12 :: 3:—- 


Error rate 


4% 


10% 


Cubtrs and Fourth Powers 


Phase 11 latency 


4.1 7 sec. 


14.96 sec. 


4 64 : 2:8 :: 3: 


Phase HI latency 


10:01 sec. 


24,62 sec. 


2 16 3 81 :■ 4: 


Error rate 


12% 


31% 
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modifications pertain lo second stage processing activities given specific assump- 
tions about ihe type of relational inferences made during the first phase of 
processing. In particular, we have assumed that exponentiation is a relational 
inference that has. precedence over simple integer multiplication, which in turn 
has precedence over addition. These assumptions were more formally tested in 
the context of the full model shown in Fig. 5.11. The data previously discussed 
also favor a model in which the second stage evaluation involves directed rela- 
tional processing. The legitimacy of such an assumption was further evaluated by 
comparing model fits for both directed and undirected^ relational evaluation. 
Finally, this processing model has two possible variants in the course of process- 
ing when second stage testing detects a mismatch or relational incongruity. In 
one mode, a relational inference process is applied to the second pair and the 
result is evaluated for the initial pair (a flip-flop procedure): In the other, given the 
presence of a mismatch, a new inference is attempted for the first pair and ag;un 
evaluated tor the second pair (a return-to-slart procedure). 

The data for both conceptually driven and interactive solution conditions was 
used to evaluate a variety of model variants: In addition, separate model filling 
was done for ihe skilled and less skilled subjects as a group. Bolh skill groups 
were well fit by models thai assume directed processing rather than a context 
independent processing procedure: Furthermore, ihe best fit in bolh skill groups 
was ihe Hip-Hop model, although the two directed processing models are 
virtually indistinguishable in the high skill group. The skill groups diftered, 
however in ihe parameters estimated for the various lypes of interences. When 
individual subjects were fit, ihe directed processing models also did well, and ihe 
flip-flop model was either consistently superior to the reiurn-to-start model or 

indistinguishable from h L 

The model fitting simply confirms the previously slated conclusions about the 
types of processing activities involved in these simple types of analogy problems, 
the relationship of such processing to problem features, and the assumptions 
about knowledge base influences on performance. Skill differences over ihe 
range sampled do not appear in ihe sequence of processing acti vines, but are 
primarily restricted to ihe duration of processing evenis. Differences also appear 
in the likelihood of discovering some less salient numerical relationships and in 
overcoming certain set or einstellung effects: 

D. Item Features, Errors, and Performance 

A study conducted by Holzman (1979). attempted to explore ihe contribution of 
different problem features lo both ihe latency and accuracy of solution on nu- 
merical analogies of ihe type we have been discussing. Ralher than focusing on 
individual phases of processing. Holzman was interested in identifying ihe fac- 
tors that influence overall solution latency and accuracy, and ihe extent lo which 
those factors change with age and skill differences within age. 1 he subjects were 
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a group of college students arid iwo groups of children, one of average aptitude 
and one of high aptitude: All individuals were given a set of numerical analogy 
problems that systematically varied a number of features including the type of 
relationship required to solve a problem, the magnitude of the relationship value, 
relational ambiguity, and the number of relationships or operations (transforma- 
tions) required to generate the problem role. 

The data obtained for the performance of the adults was consistent with the 
latency data obtained by Pellegrino et al. (Note 2) discussed previously. Fur- 
thermore, items that showed longer latencies as a function of relational am- 
biguity, low salience, or relational complexity were also the items with the 
highest error rates. The overall correlation between problem latency and accu- 
racy was - .93 for the college students. Of greater interest, was the comparison 
of the factors influencing error rates on the different item types across age and 
abiiit) groups. Regression analyses were carried put separately for the three 
groups of subjects. The R- values for the individual multiple regressions ranged 
troiii 72 to .78. The criterion was average error rate on 60 specific problems, and 
the predictors were die presence or absence of relational ambiguity in the prob- 
lem and the number of relationships or trahsforinatibhs that defined the problem 
rule. For the average IQ children, the only significant variable was the number of 
transformations The high lQ children showed an effect of ambiguity, but its 
relative eilect was much smaller than that observed for adults. Ambiguity in 
these problems re lei s to ihe presence of A-B pairs where it was possible for a 
multiplication inference to take precedence over addition relationships as demon- 
strated previously iii the adults' latency data. The failure to find any influence of 
such an effect in the average IQ children, its emergence in the high IQ group, and 
its strong effect in the adult group suggests a shift in the organization and 
retrieval of certain types of relational knowledge that is associated with age and 
schooling: 

The magnitude of the relational value, i.e., low values such as two, three, and 
four versus high values such as eight, nine, and larger, was also a significant 
variable in regression analyses for both groups of children. In addition, the type 
of simple quantitative relation played a significant role in governing the error 
rates ol the average IQ children, but had no influence in the performance of the 
high IQ children and the adults. There was a decline in performance when the 
problem rule involved division. These results can be explained by the models of 
performance described earlier arid by the role of knowledge base factors in 
influencing processing factors, primarily relational inference. The organization 
of the knowledge base and the relative ease of retrieving certain types of rela- 
tional knowledge will determine the extent to which there are_relational am- 
biguities in certain problems, thereby creating the possibility of errors Similarly, 
ihe absolute arid relative strengths of certain types of declarative and procedural 
knowledge will cause relational type i magnitude to play a role in the speed 
arid accurac) ol solution: The knowledge base is an important factor in the 
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solution of numerical analogies, and developmental changes in the knowledge 
base lead to differences in the factors contributing to processing difficulty, prob- 
lem error, and individual differences. 

I . Content Knowledge Differences and Problem Solution. A study by Cor- 
sale and Gitomer (Note 3) attempted to characterize the nature of the differences 
in the knowledge bases of high- and low-ability subjects, and to indicate how 
these knowledge differences influence subjects' problem solutions. They col- 
lected two kinds of data in order to consider the interaction between knowledge 
representation and use of problem strategies. An initial set of data was used to 
characterize the knowledge representations of subjects and a second set consisted 
of protocol data from subjects* problem solutions. The subjects were fifth and 
eighth grade children. Fifth graders have at least learned multiplication concepts 
and eighth graders have learned more complex concepts such as fractions, expo- 
nential relationships, etc.. which permitted analyses of problem solving as a 
function of different ranges of knowledge. • 

All children were given a standardized number analogy test to determine their 
general ability level. This was followed by two tasks designed to detect the 
salience of mathematical concepts in the knowledge representations of high- and 
low-ability subjects. The first task was a grouping task in which the child was 
given a matrix of numbers from 0-32, and was asked to select groups of numbers 
that went together and justify his or her groupings. On the basis of these justifica- 
tions, the children's groups were classified into four types. Examples of these 
types are shown in Table 5.8. Abstract concepts represented mathematically- 
based groupings with superordinate labels such as the set of primes, multiplicat- 
ive or exponential relationships. Operational concepts involved the stringing 
together of numbers into number sentences. Digit-based groupings involved 



Table 5.8 

Categories Resulting from Analysis of the Number Grouping task 



Abstract 
Groupings 


Operational 
Groupings 


Digit-based 
Groupings 


Nonmathematical 
(Groupings 


Multiples 
Exponents 
Primes 
Cbmposit 


Number sentences 
Computation 
Common digit 


Single digit #s 
Decade subsets 
Orthographic 


Idiosyncratic 
No Reason 

Proximity 


Factors 








Odd/Even 









From "Developmental and Individual Differences in Mathematical Aptitude* 
by K. Cbrsale and D. Gitomer. paper presented at the annual meeting of the 
Psychonomic Society. Phoenix, 1979. Copyright 1980 by K: Corsaleand D: 
Gitomer. Reprinted by permission. 
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numbers thai shared common digits, ihe sei of single-digil numbers, etc. Nori- 
malhemalical concepts were idiosyricraetic groupings or groups based on orthog- 
raphic similarities. 

In the second knowledge representation task, the child was presented with 20 
pairs of numbers and asked to state as many relationships as possible for each 
pair; The total namber of different relationships generated by each child for each 
pair type was recorded as was the number of generated relations that were critical 
for solving the analogy problems. For example, saying that 28 and 21 were both 
in the 20 's would not be a critical reason in a typical number analogy context 
whereas "21 is >4 of 28" would be. 

The various measures derived from the grouping task and the pairs task were 
reduced by means of a factor analyses. This resulted in a three-factor solution, 
and factor scores were derived for each child. The First Factor was readily ihter- 
pre table as an estimate of the degree of * "abstract hess, " A. found in the subjects' 
groupings and pair relationships. The second was a hdhrriathematica! factor, 
called "generalivity, " G. that seemed to estimate the number of groupings and 
relations tormed. The third factor represented a "preference factor,/' P, in which 
operational or computation -based groups and relations were preferred or were 
more salient than abstract groupings. 

Each of the factor scores, A, G, and P. was entered into multiple-regression 
analyses with analogy test performance as the criterion variable. This was done 
separately at each grade level. The resulting regression equations are indicated 
below. 

5lh graders; 1.26,4 + 61G (r- = .51) 

8th graders: 1.34:4 + .41 G - .4l/> (r 2 = .46) 

As can be seen; for both grades, the linear combination of these variables ac- 
counted for approximately 50% of the variance. These data reiterate previous 
demonstrations of the importance of knowledge representation in cognitive pro- 
cessing. For filth graders, only the abstract knowledge factor and the generativjty 
factor significantly predicted performance on the standardized analogy test. For 
eighth graders, preferred use of operational rather than abstract relationships was 
also negatively correlated with analogy performance. Apparently, at later stages, 
low -ability children show a continued use of operational relationships whereas 
high-ability children combine relationships to form abstract concepts in prefer- 
ence jo operational ones. The primary conclusion to be drawn from these re- 
gressions is that degree of abstractness in mathematical knowledge is an impor- 
tant predictor of success in analogical problem solving. 

Having demonstrated that the form of knowledge representation is a critical 
variable, Corsale and Gitomer examined the interactions of knowledge repre- 
sentation and strategy Usage for children of different abilities. At each grade 
level, the five highest arid the five lowest scores on the standardized analogy test 
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were selected and engaged individually in a session of oral problem solving. 
Each individual was presented with a number analogy problem was asked to 
solve it aloud. Problems were presented using a serial procedure such that the 
subject was first presented with the A-B pair and asked to generate analogically 
plausible rules, the subject was then presented with both the A-B and C-D pairs 
simultaneously so that the hypothesized relationship could be tested and, if 
necessary, reformulated. The subject was then presented with E and asked to 
generate the appropriate F. Having generated an answer or indicating that one 
could not be generated, the subject was given a multiple choice of five alternative 
answers. Each subject was given 20 problems. For each protocol, three types of 
measures were obtained: (1) the probability of successfully obtaining the analog- 
ical rule after each successive pair of numbers was presented, (2) the use ot a 
backward-interactive strategy in attempting to solve the problem, and (3) the 

kinds of errors that were made during the course of solution. 

The analysis of error data and the interactive strategy data indicate that knowl- 
edge representation drives the solution strategy by defining the limits of the 
problem domain. High-ability subjects, who have abstract, high level mathemat- 
ical concepts, limit their analogical hypotheses to a few plausible mathematical 
relationships. Low-ability children, in contrast, have diffuse, lower order math- 
ematical concepts and their analogical solutions indicate that they do not solve 
analogies with systematic, mathematically-babed rules. 

When subjects referred to a previous pair following the presentation of a new 
pair, they were credited with using an interactive strategy. The probability of 
going backward was high for all subjects, ranging from 50% to 80%, and the use 
of the backward strategy did not differentiate either grade or ability level. How- 
ever, a separate analysis was made of only those protocol* in which a child was 
initially incorrect about the A-B relationships and subsequently used a backward 
strategy when presented with the C-D pair. For these cases, the probability ot 
subsequently arriving at the correct analogical rule was examined. There was a 
significant relationship at both grade levels between problem solution and ability 
level. Even though use of an interactive strategy does not differentiate ability 
level subjects, high-ability subjects use the backward strategy more effectively: 
67<;f of the time, high-aptitude subjects arrive at the correct rule after using such 
a b irategy whereas low-ability subjects are successful only 20% of the time {p 
< .001 ). Their probability of obtaining the correct relationship when subjects do 
not use an interactive strategy is only about 25%; this demonstrates that the 
interactive strategy is mediating (he effective performance of high-ability sub- 
jects. . * . : 

Qualitative analysis of the error data helps to explain the ability difference in 
the effectiveness of the interactive strategy: Errors were defined as either 
violations of mathematical constraints or analogical constraints. Examples ot the 
different error types are presented in Table 5.9. Mathematical violations were of 
two types: computation errors or digit errors in which the subject treated a 
number not as a total concept, but as a set of isolated digits. The statement: "64 
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and lb go together because they both have a 6 in them" is an example of a digit 
error. Analogical errors were oT six types. Nohrestriciive errors involved the 
correct characterization of a similarity within pairs that was not specific enough 
lor analogical solution. Scries errors involved turning an analogy problem into a 
series problem. Single-pair errors occurred when the subject adopted a rule to 
apply to t: that was (rue only of A-B or of C-D. bat not both. Children who 



Table 5:9 

Numerical Analogy Error Types and Examples 



Error Type 



Definition 



A. Computation (MO 
8. Digit (MD) 



I Mathematical 
Arithmetic error 
Treating numbers as a set 
of digits 



Example 



"12 x 13- 169." 
"64 and 16 are related be- 
cause both have a 6 in them:' 



A. Noriresirictive (NR) 



B. Ser.es (SER) 



C Single Pair (SP) 



D. AC - 8D (AC - BD) 



E. Nonanalogical 

computation (NAC) 



F: Directional (DIR) 



II Analogical 
Correct characterization of 
number pairs that is riot 
specific enough to allow an- 
alogical solution 
Stating a serial pattern across 
pairs 



Using a correct relationship 
that applies to only the A:B 
or C D pair, but not both 



Looking for relationships 
across pairs instead of within 

pairs 



Computations that are not 
constrained by identical 
pairwise relationships 



Applying the correct operator, 
but in the wrong direction 



"1 1 and 33 go tA9^thsr be- 
cause they are both odd." 



In the problem 

28:21 :: 24:18 :: 20:_. the 
subject may say that the dif- 
ference between the first and 
second numbers decreases by 
1 with each successive pair. 
In the problem 9:18 6:15 
:: 3: — t _where the rule is act- 
ually + 9, the subject may 
apply a x 2 relationship 
derived from consideration of 
drily the first pair 
In the problem 10:40 :: 6:36 
:: 5:~, the subject may 
notice that 10 - 6 = 4 and 
that 40 - 36 = 4, yet be un- * 
able to come up with the cor- 
rect analogical rule of A + 30 

= b; 

in the probjem 2:4 Li_?:64 
:: 5:~, the subject_rnay say 
that the answer is 16 because 
2x8= 16. 

If the rule is to multiply by 3, 
the subject may divide by 3. 



Note. Adapted from "Developmental and Individual Differences in Mathematical 

Aptitude" by K. Corsale and D. Gitomer, paper presented at the annual meeting of 
the Psychonomic Society, Phoenix. 1979. Copyright 1980 by K. Corsale and D. 
Gitomer. Reprinted by permission. 
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looked for relationships across pairs rather than within pairs were considered to 
have made an ACBD violation: Nonanalogical-computation violations were 
analogically inappropriate computations. Finally, direction violations were those 
in which the subject applied the correct rule but in the wrong direction. Table 
5.10 indicates the mean errors for each grade and ability group. The most 
obvious result is the lack of grade differences in error frequencies. Rather, any 
differences in error frequency seemed to be due to ability differences. 

Analyses of variance indicated a three-way interaction of grade, ability level, 
and error type: tow-ability children at both grade' levels committed more 
nonanalogic computation, nonrestrictive. and digit errors. They also made more 
mathematical computation errors although this difference was hot significant. 
The kinds of errors they made indicated that low-ability children do hot restrict 
their hypotheses concerning an analogical rule to mathematical concepts (as 
noted by the digit errors) or to analogical concepts (as noted by nonanalogic 
computation). These findings are consistent with the data presented earlier, 
which indicated that these low-ability subjects jad more diffuse, less structured 
knowledge representations of mathematics. 

The parallel between knowledge representation and solution strategy can also 
be seen in errors of the high-ability subjects. Although the series error was 
not significant in differentiating between high- and low-ability subjects, it was 
the only error committed more frequently by high-ability than by low-ability 
subjects. However, this is a sophisticated kind of error involving the detection of 
mathematical relationships that follow a constrained rule. Again, the knowledge 
representation data, which indicated constrained mathematical concepts for these 
individuals, parallels their Use of that knowledge as seen in the kinds of errors 
they make. 

High-ability children, when they could not detect a rule, would /'give up" 
and hot select a multiple-choice answer whereas low-ability .children would 
select an answer — usually a wrong one — and justify it post hoc. Such differences 



Table 5.10 _ . 

Frequencies of Errors by Grade. Abilit y, and Error Ty pe as Defined in Table 9 



Grade 


Ability 


MC 


Mb 


NR 


SER 


SP 


ACBD 


NAC 


DIR 


5 


tow 


6,0 


9.4 


6.8 


1.0 


3.4 


0.2 


14.2 


0.4 




High 


1.8 


2.8 


i.e 


3.2 


0.8 


0.8 


0.4 


0.6 


8 


Low 


6.4 


3 6 


15:6 


1.2 


3.0 


0.0 


8.4 


1.6 




High 


0.6 


2,0 


1,4 


3.0 


02 


1:4 


0.2 


0.0 



N Qle , From "Developmental and Individual Differences in Mathematical. Aptitude" 
by K. Corsale and D. Gitomer. paper presented at the annual meeting of the 
Psychonomic Society. Phoenix. 1979. Copyright 1980 by K. Corsale and D. 



Gitomer. Reprinted by permission. 
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were found in both grades but were only significant (p < ;05) tor the olden 
children High-ability children operate within both mathematical and analogical 
constraints in order to achieve a goal of an analogically correct answer. They 
give up rather than choose an answer that they know is wrong. Not only do 
low-ability children choose the wrong answer rather than give up, but the pro- 
tocol evidence suggests that (hey are perfectly happy with, and can justify, their 
choices on nonanalogical and/or nonmathematical grounds. 

Considering both the knowledge representation data and the protocol data, ihe 
s<udy by Cor sale and Gilomer {Note 3) suggests that high-ability subjects have a 
greater degree of abstract mathematical knowledge and a greater salience of 
abstract over operational concepts. In addition, this knowledge correlates with 
and predicts analogy performance. Finally, and most importantly, high-ability 
subjects use their knowledge of abstract number relationships ib constrain the 
domain of permissible operations. Thai is, the knowledge representation sets 
conditions on the appropriate use of strategies. As an illustration of this last 
point, consider the differences between high- and low-ability fifth graders who 
were not ver> familiar with exponential relationships . H igh : abi I ity children were 
able to limit their hypotheses to multiplicative ones and often came up with the 
correct exponential rule by looking for relations between A-B arid C-D. Lbw- 
abiliiy children, on the other hand, often engaged in ribri analogical computation 
arid riorireslrictive errors. They did riot Have the highly cbrisirairied brgariizaiidrial 
structure of abstract knowledge that would provide iheiri with constrained rules 
of operation. 

VII. COMPONENTS OF VERBAL ANALOGY SOLUTION 
A. Overview 

The preceding discussion of numerical analogy solution introduced the problem 
of know ledge- base influences upon performance. A major issue was the rela- 
tional ambiguity for pairs of numbers arid how such ambiguity relates lb what is 
stored and retrieved in the course of solving number analogies. Problems of 
representational variability are of even greater concern in the case of verbal 
analogies. In attempting to define the rule relating a pair of verbal concepts, there 
can be many different representations thai vary in their level of detail or com- 
pleteness with respect lb the correct rule tor the problem. The number and type of 
semantic features thai are accessed and utilized in defining a role is difficult to 
specify arid can vary greatly over individuals and age groups. Representational 
variability also is involved ai the level of encoding the individual terms. Verbal 
concepts represent rich information sources that can and do vary in their repre- 
sentations given particular contexts and individuals. (The latter problem is less 
apparent iii the case of encoding numbers or figural elements:) Because of this 

i 
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indeterminancy in the representation of the semantic features defining the indi- 
vidual terms and relationships, there will be a problem in specifying the single 
best answer for a problem. A number of different answers may show overlap 
during a match comparison process, and; as a consequence, discrimination 
among choices and extended feature processing may be the rule rather than the 
exception in verbal analogy solution: 

As in the previous sections on figural and numerical analogy solution, we will 
first consider a process model for analogy solution as applied to verbal analogy 
problems. This model provides the context for the discussion of various types of 
problem features that affect overall item solution. This will be followed by a 
discussion of various types of verification and forced-choice latency data that 
show the effects of item feature manipulations oh processing. The discussion of 
data on item- feature processing will also consider skill differences in processing 
Finally, we will consider the relationships among item features, errors, and 
performance. C 

B. Problem Features arid Processing Models 

The processes involved in verbal analogy solution and the semantic factors 
influencing solution have Been discussed by a number of individuals (e.g., Gen- 
tile Kessier & Gentile, 1969; Rumelhart & Abrahamson. 1973; Sternberg, 
1977- Whitel'y 1976; Willner. 1964; Ingram & Pellegrino, Note 5). The model 
snown lr1 Fig 5.14 is a representation of the components of analogy solution as 
applied to verbal analogy verification. According to this model, there >s an initial 
encoding of the A term followed by an encoding of the B term and an inference 
of the semantic features of the A-B relationship: The next phase of processing 
involves encoding of the C term arid a possible mapping of the semantic corre- 
spondence (it any) between the A and € terms. The final phases of processing 
include encoding the D term, inferring the semantic features of the C-D relation- 
ship and a test of the match between the A-B and C-D relational features. As 
shown in the figure, such a comparison and decision process can have three 
possible outcomes based on the extent of match or mismatch between the inferred 
relationships. ■ t •• ■ 

The semantic features that differentiate among items arid that influence pro- 
cessing can be divided into two classes according to the locus of their effects. 
The first is factors associated with the stem or first three items of the analogy and 
the second with the set of possible completion terms. One factor of the item stem 
that has been examined previously is the type of semantic relationship repre- 
sented by a particular analogy problem. Global analyses of verbal analogy prob- 
lems drawn from standardized tests reveal that the majority of items can be 
classified by a limited set of relationship types (Ingram & Pellegnno, Note 5; 
Haynes. Dawis. Monson, Lopex, & Soriano, Note 6): Included among these are: 
Class membership, function, location. part-Whole, order in time, and property. 



54 



5 APTITUDES FOR LEAHNINb 321 



Tabic 5.1 1 provides sample analogy stems and definitions for various types of 
semantic relations tound in analogy problems. The reality of such a classification 
scheme is manifest in sorting data such as that obtained by Whitely and Davvis 
(1974) where undergraduates were found to group items on the basis of such 
relational categories. 

We have holed elsewhere (Pellegrini) & G laser, 1980) that identifying the 
semantic relation class as a I actor in item differences does little to predict sys- 
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FiG. 5.14. Siuipitl'icd process model for verbal jnalogy vcntication task. 
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Relation Type 



Class Member 



Pari Wnole 



Order 



Property 



Function 



Conversion 



Location 



Part-Whole 
& Function 



Table 5.11 
Examples of Analogy Relation Types 



Definition 



Analog y Example 



a) one term is a specific 
instance of the (more 
general} other term 

bl both terms are instances 
of a more general class 

one term is a part of 
the other 



one term always follows 
the other in time 



one term has the Property 
or quality defined by the 
other 

a) one term performs some 
function for or action 
on the other 

b) one term performs the 
function defined by the 
other term 

brie term is made from or 
is a product of the other 

a) one term is located in, 
on, or about the Oiher 
often or always 

b} one term performs some 
activity in, on, or about 
the other often or always 



one term is a part of 
the other arid performs 
a s pecialized fun ction 



Biology :Science :: Sculpture: 



Wolf:Dog :: Tiger: 



Paragraph .Sentence :: Sentence: 



Acbrn:0ak :: Bulb: : 



Green:Emerald :: Red: 



Man: Bread :: Horse:- 
Ear:Hear Eye: 



Sail:Cloth :: Oar:. 



Butter: Bread :: Sugar: . 



Train: Rails :: Automobile: 



Car: Brakes :: Ship.. 



tematic effects of this factor on performance. One reason for this is that, with the 
exception of class membership versus property comparisons (e.g.. Collins & 
Quillian 1969). relatively little is known about differences in the inference ot 
different' types of semantic features or relations. A second problem is thai 
categorizing the general relationship type captures the most salient relational 
feature for a pair of terms, but fails to capture the number of specific features that 
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must also be represented. Third: it is difficult to make predictions about the 
similarities and differences among items of the same relationship class in terms 
o! the relative case and iikciiiiood of interring the appropriate semantic feat ares: 
These problems require a normative analysis of the extent to which items differ in 
ease of extraction of appropriate, semantic ihToniiatibh. - 

lngiam and Pellegrhio (Note 5) obtained normative data on the generation of 
completion terms for various analogy stems of the same relation type. There were 
substantial differences in the semantic appropriateness of responses generated to 
complete the analogies. Kir some items, only 50% of all the responses were 
appiopnaic. while lor other items. 99% of all responses were semantically ap- 
propriate Differences were a^o observed in terms of the size and distribution of 
the set of answers generated for specific items: Across items, the single most 
irequeniU generated answer for an item was given by 10% to 80% of the 
subjects. These data indicate substantial differences in the constraints on seman- 
lie leaturc piocessthg across items and individuals: 

The second locus of effect in semantic feature processing involves the set of 
possible completion terms. I or any given analogy, there is a set of acceptable 
iesponses that vary among themselves in generative probability^ and that could, 
satistv the semantics of tiic item. Normative differences in the production of 
appropriate completion terms can be considered as representing a "goodness of 
ill" oi semantic distance t actor (e.g.. Rumelhart & Abrahamson, 1973; Smith, 
Rips. & Shobcu. 1^74). This factor should affect decision time in a verification 
task given processing assumptions of the type represented in the model shown in 
Hu. 5. 14. 



C. Data and Theory on Item Processing 

I W rijuaiion Tasks. A set of verification studies was conducted (Pelieg- 
nno M Ingram. Note 4) that examined processing differences among items with 
diiieient t>pes oi completion terms. Four types of completion terms were used. 
The iusi two t\pes were acceptable answers that differed in seman-x appro- 
pnateness ihigh'veisUs low ). Two other types of compietion terms were analogi- 
cali> incorrect, i.e., they failed to represent the appropriate relation given in the 
stem of the analogy. One of these terms was a strong free associate of the C term 
and the other was a very weak free associate of the C term. College students 
differing in analogy solution skill (as assessed by the Cognitive Abilities Test 
(Thonuiike £ Hageri. 1971, and torge-Thorndike Test. 1964) were presented 
240-400 separate items for verification, and overall latency and accuracy on the 
individual items were measured: Presentation of whole analogies and parts ot 
analogies in sequence Were used to estimate, In an additive fashion, the compo- 
nent latencies for each of the processing stages of the model presented in Fig: 
5.14. In addition, estimates were made of the probabilities that extended feature 
analssis and relation comparison would be required by each of the four types. 
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The icit column of Tabic 5.12 5, hows the parameter estimates obtained tor the 
group mean data. The correlation between observed and predicted values was .98 
with an RMSD ot 198 msec, As can be seen in Table 5.12, the low-associate 
items have a very low probability ot requiring extended feature analysis before 
being rejected. In contrast, the high-associate items have higher probability ot an 
indeterminate initial match thus requiring further feature analysis before rejec- 
tion. As expected, the low-appropriate items have a very high probability of 
requiring extended feature analysis prior to acceptance. The high-appropriate 
items, which vary widely in their normative strength, also show some probability 
of requiring extended feature analysis prior to acceptance. The pattern of results 
suggests that analogy Verification may involve an initial global semantic feature 
analysis that provides the basis for selecting and rejecting extremely good and 
bad answers. 

Model luting also revealed skill differences in the precision of the initial, 
inference, comparison, and decision processes. Subjects were classified as either 
skilled or less skilled solvers and the data were separately modeled. Tabic 5.12 
shows the parameter estimates obtained from fitting the mean data for each ot 

Table 5.12 

Latency Parameters for Verbal Analogy Verification Task 



Pjfdfneter 
Encode A ta) d 
Encode 6 & Infer A 8 (b) 
Encode C & Map A e (c) 



All Subjects 
IN- 150) 



Skilled 
(N=60) 



Less Skilled 
fN,*60) 



Encode D. Infer C D, & Compare (d) 
Extended feature analysis (e) 



183 
326 
407 
1425 
1171 



Probabilities of extended feature analysis 

a (high appropriate) -23 

u (low appropriate) -55 

a (high associate) «19 

a (Sow associate) 0? 

Response (r) 472 



77 
233 
308 
1 179 
1230 

,13 
,46 
.17 
.03 
543 



173 
302 
360 
1527 
1013 

,32 
.65 
.43 
.25 
489 



a Smaii letters in parenthesis refer to Figure 14; 
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those groups lii both cases; the correlation between observed and predicted 
values was . 97 and the RMSDs were less than 272 msec. The general pattern 
obtained iii both .skill groups was the same as that just discussed lor all subjects: 
Both groups seem to be sensitive to the same sets of semantic variables at the 
level ol individual completion terms 

There were, however, ditterences between the two groups that suggest dit- 
teiences in the quality or precision of the initially inferred semantic information. 
The low skill group showed higher probabilities of extended feature processing 
lor all four tvpes of completion terms. The largest difference relative to the 
skilled subjects was with respect id the processing of high associate incorrect 
completion lerm.s. Thai less skilled individuals seem particularly susceptible to 
this (>pc of item sucaesis an incomplete or sparse feature analysis and representa- 
tion durine ilie initial stages of processing: The latency estimates for the compo- 
nents of stem processing show ed a relatively small difference between the skilled 
and less skilled subjects up to (he point of presentation of the D term. At that 
point there emeiged a substantial difference. Thus, it would appear that skilled 
subjects are no lasier in Hie initial phases of processing, but may extract more 
information that leads to faster and more precise decisions about individual 
compieiioii terms Less skilled subjects seem to extract either less information or 
more global relational leaiu.es. this makes subsequent decisions more difficult 
and lime consuming A possible interpretation of such results is that less skilled 
individuals arc to. cod lor choose) to solve Hems interactively. The implication 
that skilled individuals develop higher level and more precise initial problem 
representations is supported by studies of performance differences on other ap- 
titude tasks (e.g.. t-:g..n. 197K; Sternberg. 1977). Thus better representation 
facilitates the speed and accuracy of final solution 

Our discussion of the influence of item features on processing has been 
limited to differences m the semantic features of the individual completion terms 
that were presented. Such results are applicable to all items and permit the testing 
Lii tile general model m lig 5. 14. In addition to Systematic latency patterns at the 
level of individual completion terms within items, there also were systematic 
latency differences between items. Type of semantic relation had a significant 
eitcct on overall solution laiency as did the degree of semantic constraint as 
estimated from normative data. When the latency to solve an item was divided 
into stem processing time versus processing associated with the completion term 
and the maich between relations, there were significant effects of both semantic 
relation type and semantic constraint in both stem and completion term process- 
ing. 

2 Ion , ./ C /ic/.c 'fiisis. A substantial number of verbal analogies require 
some form ol extended feature analysis 'o accept the •■besf answer arid items 
vary widely in the consensual agreement about what are ■■best' ' answers. Thus, 
forced-choice analogy solution may require considerable amounts of interactive 
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processing involving the relative match comparison process as discussed earlier. 
In aii attempt in examine such a possibility ; normative data were obtained from a 
uroup oi college students on the semantic appropriateness of each response 
alternative. Individuals were presented with analogies drawn from the Cognitive 
Abilities lest, and the alternatives were individually rated with respect to their 
appropr.atehcss lor completing the analogies. The values assigned to each alter- 
native tor a uiven problem were used to derive discriminability indices (a d[ type 
procedure was Used). The items showed wide variance in the discriminability 
values and some nems even had negative values, indicating that the college 
students actuallv rated incorrect options as being more appropriate than the 

correct one: - - 

A second group of college students was then asked to solve these items. 1 hose 
items with a hi ah level of discriminability were solved more rapidly with less 
repetitive cvcling through the alternative set prior to final solution. The overall 
correlation between the index of discriminability and time spent in processing the 
alternatives was - .79. Protocol data obtained from yet another group of college 
students indicated that such items often required interactive solution procedures 
ol the complex type shown earlier in Fig. 5.3. 



D. Item Features, Errors, and Performance 

1: Vcnluanon Tasks. The iaciors that influence the latency of analogy 
verification also influence the accuracy of solution: Answers that could be con- 
sidered as less appropriate completion" terms take longer to accept, and require 
extended feature analysis before being accepted: Such completion terms have the 
highest probability (.26) of being rejected as unacceptable completion terms. The 
rejection of completion terms of this type can be viewed as an error. Alternatives 
,hal are analogically incorrect but high associates of the C term have some 
probability of requiring an extended feature analysis prior to rejection. Individu- 
als sometimes accept such completion terms and thereby make logical errors 
(PS The most approprite completion term has a comparable probability ot 
extended feature analysis and an equivalent error rate (.11). The least appropriate 
completion, which has the lowest probability of requiring extended leature 
analysis prior to rejection, has the lowest rate of error (.07): 

Still groups not only differed in latency but also in accuracy in the verification 
task Table S 1 1 shows one of the significant interaction patterns obtained tor the 
skill group contrast. As can be seen in the table, both groups show the same 
ocneral pattern across types of completion terms. The most outstanding dit- 
Terence in the pattern of errors is the much lo wer error rate of the high-skill group 
on the analogically incorrect completion terms, particularly the incorrect high 
associates As was argued before with respect uf the model fits tor the latency 
data it appears that less skilled reasoners have less adequate teature repre- 
sentations that lead to longer limes to accept and reject completion terms and 
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Table 5.13: 

Error Probability for Verbal Analogy Completion Terms 

















D (High 


D ( Low 


D (High 


D ( Low 




Appropriate) 


Appropriate) 


Associate) 


Associate) 


Skilled 


.07 


.24 


.03 


.03 


Less Skilled 


.12 


.32 


.15 


.10 



greater likelihood* of accepting analogically inappropriate answers, A related 
arid consistent rinding was that the largest difference between the skill groups in 
error* was oil i lie Hem* with low levels of seriiaritic constraint. Thus, as semantic 
tcaiure extraction becbhics riibie difficult, the diHererice between skill groups in 
the representation of seriiaritic feature* becomes more apparent. 

2. KiYrvVtl-X. lioiVe Tasks. Item difficulty in a forced-choice procedure is a 
function of both stcrii arid option processing. Evidence for such relationships 
conic* froiii correlation* between iteiii difficulty indices and stem and option 
proces*mg latencies on standardized test items (Heller & Pellegrino, Note 7). 
College students solved item* that varied substantially in item difficulty and the 
separate correlations of item difficulty with stein processing latency and option 
processing latency were .44 and .79 respectively. Both the latency and error data 
suggest that a substantial proportion of the difficulty in solving standardized test 
item* i* associated wiih choice diseriminability and the need to invoke relative 
match comparison processes. A* further support of this_ conclusion, measures 61* 
choice discriminabiiity also correlate at the level of .87 with item difficulty. 

3. f'nn cttutnf KhokxTiul^e l)if)vri'nccs and Problem Solution. In bur studies 
of verbal analogy verification arid lorceU^chbice pertbnriarice , we have been 
considering the pertbnriarice of college students who vary in skill. The variations 
that exist arc not at the procedural level arid do hot seerri to reflect differerices iri a 
knowledge of ia*k cbristrairit*. All our college students see ill to reason analogi- 
cally, albeit with significant differerices iri the speed, precision, and accuracy of 
whai is represented and processed. However, studies of high school (Heller, 
1 979) and elementary school (Goldman, Pellegrino, Parseghiari, & Sail is, iri 
pre**} student* indicate thai an important aspeet of j^rfortriarice differences may 
involve knowledge of task constraints arid procedural knowledge that is required 
to satisfy the goals arid cbristrairit* of analogy solution. These studies of verbal 
analogy solution show numerous instances of solution procedures that violate one 
or more of the constraints of analogical reasoning: 

Heller ( 1^79) examined the solution episodes of college and high school 
students to determine whether they included behaviors that violate task con- 
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Table 5.14 
Sample Solution Protocols 



Analogy Elements Presented Solver's Response 

Analogical Solution: [__Proti»ml_1 
Conceptually driven; one option matches initial specifications 

TEA;COF FEE : : BREAD: Tea is to coMee as bread Is to . . . rolls 

they're both drinks, and they're about the same thing, just 
two different names for two^jfferent drinks, and a bread and 
a roll would be about the same— two different names for the 
same thing. 



MILK 


(Reject) 


That doesn't fit, it's a drink. 


BUTTER 


(Reject) 


Butter is something you put on bread, that doesn't fit. 


ROLLS 


(Accept) 


That's good. 


JAM 


(Reject) 


It's like butter, something you put on bread, it wouldn't 
fit because you don't put coffee oh tea or in tea: 



Analogical Solution: Protocol 2 
Interactive; initial failure to identify _A : B rejaj|On^ria logical rule 
identified during option verification 



ABATE:DECLINE : : WAX: This is a good one. Oh Christ, I don't know— I can't say 

anything yet because I don't know what "abate" means. 

Well, wax and polish mean A'mP^weH [ j^ey 're ver^ close, 
and maybe abate and decline are very close. I don't know, 
I'm just gonna put true. 

I just don't know. 

To me, decline seems to have something to do with abate* 
even though i don't know what it means, but wane doesn't 
have anything to do with wax. 

I was thinking, maybe abate means "to decline" because 
wax may mean "tojmprove:" Arid like before, It means 
"to polish." I like polish bett er, though. (Table contin ued) 

Note . From "Cognitive Processing in Verbal Analogy Solution" by J. I. Heller, unpublished 
doctoral dissertation, Uriiversity of Pittsburgh, 1979. Copyright 1980 by J. f. Heller. 
Reprinted by permission. 



_» 

POLISH (Accept) 



INCREASE (Reject) 
WANE (Reject) 



IMPROVE (Reject) 



SB 
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(table 5.14 continued) 



Analogy Elements Presented Solver's Response 

Non-Analogical Solution: Protocol 3 
Consideration of C D' relations drily 

LINE -RULER : : CIRCLE: Bali. Because a ball is a circle, it's round: 

ROUND (Accept) Yeah, a circle is round. 

DRAW (Accept) No. because draw can't be a circle. Oh! Yes, it could be 

because you draw a circle. 

RADIUS (Accept) Radius is the numbers in the circle, that's good: 

COMPASS (Accept) Compass you use to go arburid^like you put your pencil 
and it's a circle. 

(Which of these do you think 

best c ompletes the analo gy?? Round, because a circle is round: 

' N on -Ana logical Solution: Protocol 4 

Identification of A B arid C D' relations; no relational comparison 

TELL: LISTEN : : GIVE: Take. If you tell something, they're like taking it in. If 

ybu give something, they take it: 

Tell is to listen as give is to present? Yeah; I'd go with that! 
You give presents? 

No. Most people find something, they ain't gonna give it 

back: 

Yeah. If you get something, somebody gave it to ybu. 
When they give it to ybu. ybu have it. Yeah. 



PRESENT 


(Accent) 


LOSE 


(Reject) 


GET 


(Accept) 


HAVE 


(Accept) 



(Which of these do you think Present. Because ybu give presents, 

is best?) 



(Table continued) 
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(Table 5:14 continued) 



Analogy Elements Presented 



Solver's Response 



Non-Analogical Solution: Protocol 5 
Consideration of A-8-C D interrelations only 



SOBJECTiCITIZEN : : KING: 

{Could you explain how you 
got thai?) 

{What about subject and citizen 
made you think you'd need 
something that went with a king?) 

RULE (Accept) 



(Could you explain a little bit 
mote what subject has to do 
with citizen and king has to do 
with rule?) 

KNIGHT (Reject) 
(What is * "r.ni^iu?) . 

PRESIDENT (Accept) 

(What do you mean "They are 
subjects?) 



KINGDOM (Accept) 

(You said that president, 
kingdom, and rule are pos- 
sible, Which of those th ree do 
you like the best?) 



{And how do they connect with 
subject arid citizen?) 



King— king— queen. 

Well, subject to citizen—like the king js married to a queen 
so I figured king arid queen. They stay together. 

Well, citizeri is a person and is Like a subject. So I figured 
that king and queen ought to fit into it: Same as subject 
arid citizen: If I hear you talking about a subject, then it's 
probably the queen. 

This one is a good one here because you're describing the 
rules. The king and rule is almost jike the citizens arid rule 
arid I think that, i guess this is a pretty good one. It's 
kinda hard. 

Well, the subject is a type of one thing arid a citizen is like a 
person. So the king is a man who's higher arid the rule is— 
the king rules [ho citizen. 



I don't think sb: Because knight-t can't really say why. 

A kriight is a man that guards the king, that's ail I can 
really say. 

This one's all right: President— king's almost the same thing, 
and both of them are citizens arid they Ye subjects: 

Well, it's somethirig— subject to Something— I can't explain. 
King and president are citizens and they're subjects to 
another person— they Ve the subject of what other people 
are talking about. 

This one's all right because the kingdom's where the king 
lives: I guess it's all right— I can't §6 against it. 
President: I like the king and the president because they *re 
almost the same persons, they both rule in different places. 



Because they're both citizens and are subject to a person. 



stfaints: Analogical solutions contained no violations of task constraints, and 
were characterized b>: 1 1 ) consistent attention to the relations contained in two 
allowable *oid pairs, and (2) consistent attention to the match between these 
pairs of relations. Nonanalogical solutions are characterized by: (1) attention 
6ni> to relations between illegal" pairs ot elements, and/or (2) consistent 
attention to the match between inappropriately selected pairs of relations in two 
word pairs, and/ or [M a consistent disregard for the match between relations 
contained m two word pairs. Bu-gy" solutions (the temi is borrowed from the 
computer programming notion of procedural bugs with missing or faulty sub- 
routines) contained both ol the types of behavior described for analogical arid 
nonanalogical solutions. Bugs included suspension of consideration of the match 
between two relations, consideration of the match between inappropriate word 
pairs, or • 'forcing " a match between two relations by stretching the interpreta- 
tion of relations between word pairs: Sample solution protocols tor analogical 
and nonanalogical solution types are shown in table 5.14, protocols one through 
live (Heller. 197S>). 

Heller found differences m the availability and utilization ot analogical solu- 
tion procedures anion- a small sample of college students (high ability) and high 
school students (intermediate and low ability). Table 5.15 shows the proportion 
of each type of solution in each of the three ability groups where ability reflects 
overall differences in performance on standardized analogy items. The propor- 
tion of analogical solution decreases with decreasing ability level, J the 
categon/alion\>! solution type is independent of the correctness of the final 
choice. 



Table 515 

Mean Proportions of Anal -hci! Nonanalogical and 5 Buggy" Analogical Solutions 
lor High, Intermediate, and Low Ability Solvers 



.ability Level 3 



Solution _ High Internnediate Low 

Analogical -99 

"Buggy" analogic j'l ; 0J ^ 

Nonanalogical 9 ^ ' 



a Hiah ability subjects were 20 college students 
Intermediate ability subjects were 6 tenth grade students in the upper 

quartile of verbal ability ' 
tow ability subjects were 9 tenth grade students in the lower quartile of verbal ability 

Note From 'Cognitive Processing in Verbal Analogy Solution" by J. I. Heller, unpublished 
doctoral dissertation. University of Pittsburgh. 1979. Copyright 1980 by J. I. Heller. 
RepririteO by permission. 
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While ihe data in fable 5.15 reflect average performance within each ol the 
three ability groups, they are not necessarily indicative of either an individual's 
consistency in strategic performance or of individual differences within each 
group. To identify individual patterns in performance. Heller determined proliles 
of each solver based on the kinds of solutions he or she utilized over the entire set 
of items. Reliance upon consistently analogical behavior is a characteristic ol 
skilled analogy solvers. Whereas 85% of the high-ability individuals solved all 
items with an analogical solution procedure, none of the intermediate- or low- 
ab.l.ty solvers solved all items analogically. While all of the individuals m the 
miermediaie-ab.l.iy group were capable of solving items analogically they did 
not do so consistently. The majority of the low-ability individuals (67%) were 
also capable of solving items analogically, but again, did not do so consistently. 
Three individuals within this group, however, solved no items using entirely 
analogical behavior. These data suggest major differences in the global types ol 
solutions utilized by individuals of different abilities: Not only is the analogical 
solution procedure relied upon far more consistently by higher-ability individu- 
als hut it appears to be unavailable lb some low-ability individuals. 

b.tte.enLcs in solution behaviors were also observed in processing activities 
wtih.n analogical solution episodes: All high-ab.lity solvers utilized the 
addmonal p>oeesses requ.red for interactive solut.ons in their solutions ot some 
nenis However, among those who used analogical solution, some mtermed.ate- 
ah.l.iv solvers (17%) and half of the low-ability solvers never solved items using 
( he additional processes required for interactive solution. Thus, it appears that 
iov.-ab.lnv solvers are less likely to solve items analogically; when they do 
reason analogically, they are less likely to demonstrate the complex processing 
required lor interactive analogical solutions. High-skilled individuals, con 
ve.scly are charade, i/ed by a more adequate knowledge ol task constraints and 
an ability to develop an understanding of ihe analogical rule using additional 

information generated from the response options. 

Thus similar to the results in the study of numerical analogies, individual 
dlllerences in verbal analogical reasoning ability appear to correspond to the 
differential ava.labil.ty or utilization of the additional processes required in in- 
teractive solut.ons. In items thai are solved analogically, low-ab.l.ty solvers 
show a h.gh proportion of conceptually-driven solutions. Where an initial in- 
ference is easy or possible, ihe inference is made and maintained throughout 
soioi.on. Although some low-ability solvers are also capable of modifying rules 
and solving nems interactively, the frequency of their doing so is less than that of 
h.uher-ab.hty solvers. On more difficult items, which are less likely to be solv- 
able in the conceptually-driven mode, low-ability solvers exhibit performance 
that violates task constraints. ---- . . ,. 

The foregoing data argue for the presence of ability differences at the level ol 
procedural knowledge. A major difference in the representation and understand- 
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ing ot task constraints is suggested by the presence of individuals who never 
reason analogically, and some incidence of nohahalbgical behavior in the so- 
lutions oi biiih the inieimediaie- and low-ability solvers. There are a variety of 
ways iii which nonanalogical behavior can be exhibited and these can be 
classified, at a gross level, in terms of the amount of information that is being 
attended to in the item. Table 5.16 presents data on the nonanalogical solutions 
of the intermediate- and low-ability solvers in terms of the proportion of cases 
showing diiierehi violations of analogical constraints. 

Three types of, nonanalogical sjlutions were identified: One type in which no 
attempt was made to identity the A-B relation — attention was paid only to the 
presence L »r absence of C-l) relations. A second type represented solutions in 
which all four analogy terms were considered, but attention was paid to the 
interrelations among three or four terms rather than to the match between two 
distinct relations wiihiii element pairs: A third type represented solutions in 
which aii atlcmpt vCas made (either successful or unsuccessful) to identify both 
A~-U and i I) reliaiohs. but no apparent attempts were made to determine 
whether any iwo iehiiions matched; All three of these violated the central con- 
straints of the analogy task - that behavior should be directed toward identifying 
two distinct relations thai are analogous or matching. However, the three con- 
form wiili task constraints to different extents, i.e., nonanalogical solutions by 
the low-ability solvers were primarily of the types where no attempt is made to 
identify the A-B relation or to refer to two distinct relations, while, in contrast, 
intertnediaie-abilil) solvers considered all four terms in most of their nonanalogi- 
cal solaiions; and attended to two allowable relations. 

in general, this research suggests that skilled analogy solvers are characterized 
b> greater knowledge of task constraints, and by the ability to develop an under- 



Table _16 

Proportions of Nonanalogical Solutions of Each Type for 
Intermediate and Low Ability Solvers 



Nonanalogical 
Solution Type 

t. Only C 0 relations considered 

£J. A-B C D interrelations considered 

EQ. A-B and C D relations considered 
but no relati onal comparison 

Note. From "Cognitive Processing in Verbal Analogy Solution" by J. I. Heller, unpublished 
doctoral dissertation. University of Pittsburgh, 1979. Copyright 1980 by J. I: Heller. 
Reprinted by permission. 



Ability Level 



In termed iate Low 

:25 65 

.17 10 

.58 25 
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standing of the analogical rule in response to the item stem and set of completion 
terms. This is accomplished by suspending the top analogical goal momentarily 
and working on subgoals of the problem structure while maintaining overall task 
constraints. Conversely, less skilled solvers proceed analogically only when they 
can easily identify ah analogical rule, but if that rule is initially inaccessible, or 
no C-D relation Can be found to match the initially specified rule, they Violate 
task constraints of appropriate analogical syntax. 

The Heller study suggests a parallel between sources ot developmental dif- 
ferences and individual differences within age. The differences exhibited in the 
contrast between skilled college students, intermediate-skill adolescents, and 
low-skill adolescents were pursued further in a set of studies focusing on age and 
skill differences for children ages 9-12. In two studies, Goldman, Pellegrino, 
Parsegiiiah, & Sallis; (in press) examined the relationship between developmen- 
tal and individual differences by assessing performance in two ways: first, by 
determining the outcomes of the different phases of processing in the analogy 
task, arid second, by considering task understanding and adherence to necessary 
task constraints. 

Third and fifth graders were shown the A-B pair arid asked to describe the 
relationship between the two words. Each child's answer was evaluated semanti- 
cally to provide a measure of the success of A-B relational inference: The child 
was then shown the A-B pair and the C term arid asked to generate a completion 
term for the analogy. The child's ariswei was again evaluated semanticaliy to 
provide a measure of the success of the C-D' relational application to the A-B 
pair. Additionally, the child's response and justification were evaluated relative 
to the previously specified relationship. In this way, it was possible to determine 
if the child was attempting to meet me constraint of parallel relationships. The 
final subtask involved a forced-choice test where the child chose the best answer, 
and then verbally justified the choice: The child's performance in this final 
subtask provided data about two types of processes. First, whether the child 
could identify the correct response given that he or she failed to generate an 
acceptable term ill the previous task. Second, whether the child had the ability to 
maintain correct responding in the face of potentially interfering relational infor- 
mation. Finally, the child's verbal justification for his or her choice was 
evaluated for evidence of adherence to the constraint of parallel relationships in 

true analogies. . 

The results of this study showed age differences for all the phases ot process- 
ing. There was also substantial variability within grades both in overall perfor- 
mance on the forced-choice task and on the more detailed process outcome 
measures. The pattern of differences in both grades was lift same and the distri- 
bution of performance for the two grades overlapped substantially. The indi- 
vidual differences within a grade not only reflected developmental differences, 
but they were far greater than the mean developmental differences. Regression 
analyses indicated that in both experiments, the measures that assessed processes 
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relating pairs of relation stiip^ accounted for individual differences in overall 
performance. 

The data indicated that children varied substantially in effective use of the 
various kinds of information available to guide responding, a finding similar to 
Heller's analysis of intermediate- and low-skilj individuals. For example, skilled 
children (as defined by overall forced-choice performance) used semantic infor- 
mation in the A-B pair more effectively to guide the generation of a completion 
term for the analogy. Then, when faced with a set of alternative answers, they 
were able to rccogni/e ilie correctness of their previous efforts and find a more 
suitable answer when one was available. 

Such variability in individual performance can arise becauv- of semantic 
knowledge differences, differences in the success of process execution, or pro- 
cedural dilleiciices representing a lack of attention to details of analogical syn- 
tax I lie ialiei possibility was considered by examining measures that reflect the 
eliiklN understanding of the task. One such measure involved evidence of rela- 
tional j'aiallclism in verbal justifications for those items where the child selected 
li, , ,.-it7 response in the forced-choice 'task, 'I ;iis provides ah index of the 
chiul understanding of the need tor parallel relationships and adherence to that 
constraint The skilled children appropriately justified a correct choice over 90% 
ot the time, while less skilled children failed to do so for their correct answers 
Malt the time In the two separate studies, this single measure, based only on 
cured responses, a; dialed .73 with overall performance. 

Hie different ivpes of measures used in the Goldman et al. (in press) study 
weie derived iroiu die previously staled theory (see Section IV) of the processes 
necessary lor analogy solution and the task constraints that must also be a pan of 
l he child's representation of the task. These different sets of measures converge 
on an explanation of individual differences cons ; steiu wr v : that of the Heller 
i 1079> study, i.e.. skilled performance is associated with exacting, applying, 
and organizing sets ol semantic information to arrive at unique solutions. Knowl- 
edge ot ta ! . consti.uiits is a relevant feature of the skilled child, adolescent, or 
adult's jmmlciii space that leads to the correct organization arid execution of 
processes of reia'notial inference, comparison, and choice. _ 

iio\vc;ci. «i also jear thai poor performance is not simply a function of 
minor si. lalioii ol an overall correct solution procedure. This is to say that a 
suiLile process mod.?) of correct analogical reasoning is not necessarily the appro- 
priate scheme lot understanding errorful performance When a child shows low 
or Intermediate pcMor.oanec. one cannot assum. that this is due. to less powerful 
execution ol the appropriate set of jiis iy-iuc- and processes. Such an interpreta- 
lion assumes Y\uii \-M children, folio* the same strategy or have similar process 
models /or lask i . .nuance Kaiher, ihe data obtained by Goldman et ai. and by 
Heller t VWh in . «-c ih ii performance is a function of substantial variability 
the rcpreseniatior. . .id under landing of task constraints and accompanying pro- 
cedaiai kiiowiedi.: 
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VIII. CONCLUDING COMMENTS 
A; Discussion of Results 

The outcomes of our initial research efforts can be summarized briefly in ihe 
context of the genera! analytic scheme outlined at the beginning of the chapter: 
We have tried lb demonstrate that it is possible to construct information process- 
ing models for aptitude test tasks and to show the jeneraiity of the theory and 
models across content and formal variants of l he same task. In the course of this 
effort, wc have generated a good deal of information about the procedural and 
declarative knowledge that governs analogy ilem processing in three different 
content -symbolic domains — figures, numbers, and words. The analyses reflect 
some of the complexity of knowledge and skill that presumably underlies per- 
formance tri an analogical reasoning/problem-solving task. Considerable effort is 
still needed in theory development and experimental work. We are cautious, 
however, about the extent to which we wish to become embroiled in detailed 
efforts at studying the paradigm or task for its own sake; we need instead to m>ke 
stronger connections with psychometric concepts such as test score differences, 
item difficulty, test validity, and factor structure. 

Our present purpose in studying analogy solution was to select a key aptitude 
test performance and understand it well enough to apply the analyses to the 
problems of understanding individual differences in aptitude arid differences in 
item diH'iculty. As noted in the analyne scheme, a lest of both the theory and the 
modeling of ihe tasks is the ability to show lhat these provide a Useful basis for 
characterizing, in cognitive process cerms, individual differences in skill. We 
nave made a start in this direction and it appears thai this general problem-solving 
theory of analogy solution arid the specific task models have been able to capiure 
some interesting differences in performance. 

At the expense of much oversimplification, we infer from this work three 
interrelated factors ihai appear ib differentiate high- and low-skill individuals. 
These are ihe management of memory load, organization of an appropriate 
declarative (or conceptual) knowledge base, and procedural knowledge of task 
constraints. We have discussed each wilh reference to relevant studies of figuraf, 
numerical, arid verbal analogy tasks, and will subsequently suggest their possible 
implications for improving skills of learning: 

Studies of figural arid numerical analogy solution highlight the importance of 
the management of memory as it is reflected by differences in the speed of 
performance and the handling of demands on working memory. Our studies of 
numerical analogy solution show that the structure of the declarative-conceptual 
knowledge base and the level of representation of this knowledge can also differ 
as a function of ability: High-skill individuals employ conceptual forms of 
knowledge lhat constrain their induction of relations, whereas low : skill individu- 
al encode at more surface levels, which limits their inferential power. In our 
studies of verbal analogy solution, individuals differed in their knowledge of the 
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constraint of problem-solv irig procedures — what we have called jhe syntax of 
analogical problem solving. Kt'tcctivc problem sotDlion is characterized by 
problem-solving steps directed toward the salisfacijon ot' particular goals that are 
deierhiihed by problem-solving constraints, the more constraints ^he solver is 
aware of. the more highly constrained will be ihe goals pursued. Faced with a 
difficult problem, a skilled individual generates subgoals, pursues l hern, and can 
return to higher level goals l or ihe low-skilled individual, solution difficulty 
rebuild m violations oi" pioblein-solving constraints, the imposition of procedurai 
bugs, and the inability to recover higher level goals when subgoals need to be 
pursued. 

Another of our goals stated in the general analytic scheme was lb consider 
indivklu.il dill -reives as a function ot" development. Our studies of numerical 
.iiid veibai icasoiniig differenc- ; suggest at least two major developmental 
iierids. Hi. si. the development ot analogical reasoning ability in pan refleas the 
development ot ail understanding of the constraints or logical rcv.Kici.^ns anJ 
fequireiiicnK of this tspc of task I -or young children, the analogy task i* -^famil- 
iar Liitd it olicii teqoires considerable explanation and practice before «»i d.ild 
even appears to understand v\hat to do. At the other extreme is ihe coHe^c Modern 
who has been asked to solve analogies many limes in tesl situations eise- 
vshete; who is oiien taught b> the use ot analogy, and who apparently has a gobe 1 
understanding ol the task. (31 ten. no more instruction is required ih.iri to simply 
s.iv ; "I want uiu to solve some analogy problems" at which point the individual 
i> icivl> to piocccd, However, the Heller (1979) data on high school students 
indicate that even at tins age, there are individuals who have an incomplete 
imdcrsiandiiig. aiid some who have virtually no understanding, of ihe analogy 
la^k requirements. 

One aspect ot the development of analogical reasoning ability may be the 
gradual acquisition ot the necessary elements of an appropriate task representu- 
iibri causing ibi coinciding Willi) the acquisition of more complete and complex 
jSrbceduies lor solving both easy and ditficull problems. Younger children often 
lack the ability to solve items that require a more complex and interactive mode 
ol solution. When ditticuUics m process execution occur, or ambiguities arise, 
there is .i tendency to relax; the constraints of the task rather than actively pursue 
the appropriate set Ol goals 

Individual differences within age groups seem to reflect developmental 
trends. Skilled subjects have an appropriate representation of ihe lask, actively 
attempt to satisfy the appropriate set ot goals by using more complex arid interac- 
tive solution procedures when necessary, and only relax lask constraints when 
absolutely necessary In fact, evidence was presented thai skilled individuals 
prefer not to respond at ail rather than give an answer that they cannot justify 
given lite constraints of the task. 

The theoretical analysis of analogical reasoning arid the data on age and skill 
differences suggest a possible multilevel scheme tor the factors that contribute to 
analogical reasoning performance. These factors are: (I) the individual's prob- 
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iehi space, i.e., representation and understanding of the analogy task; (2) 
availability and utilization of the processing strategies necessary tor analogy 
soluMon; (3) organization and coordination of processes tor solution of dit'te rent 
item types (including the stability and flexibility of these processes); and (4) the 
auiomaiicily and precision of each component process. Such a scheme is useful 
when one attempts to understand why an individual performs poorly on a lest: 
The lower the level of performance, the more likely it is that the individual's 
problem exists somewhere at the top of :riis hierarchy: This is based upon the 
assumption that an inadequate problem space— representing a failure to under- 
hand the task or a weak understanding with inadequate constraints— will lead to 
chance or near chance performance. When one understands the task, but lacks 
proficiency m the component procedures for solving difficult items, then perfor- 
mance inav be at an intermediate level, reflecting a failure to deal with complex 
ilik- and ambiguous items. At the upper end of the performance range, dif- 
!c:cr..es are more likely to be manifest in the stability and coordination of the 
.dmponehi performance routines necessary to solve more difficult items. At all 
levels, declarative knowledge dillerences may also account for item failures. It is 
uUo quite likely that dillerences in analogical reasoning skill may have quite 
diUerent sources at dilferent age levels: This issue needs to be pursued in more 
depth ii we are to lulls Understand the correlations (i.e. , predictive validity) of test 
scoies witli educational success: 

HhaiK. we have vet to attack the problem of what is "genera!" across 
analogy tasks, let alone across inductive reasoning task*. We would expect that 
generality would be observed at the level of procedural skill and knowledge ot 
ta.k constraint,. We can speculate that at early levels of development and indi- 
vidual skill performance is limited to specific knowledge domains: As pro- 
cedural skills and knowledge are exercised in the context of these domains, these 
skills and knowledge becom, more abstract knowledge: This eventuates m gen- 
eral inductive reasoning ability that is then available for application to specific 
piohlems in various content domains, given that the appropriate declarative 
knowledge is also available or can be generated: 



B. Instructional Considerations 

Given what is currently known about analogical reasoning, is ii possible to 
develop diagnostic assessment procedures for the component processes involved, 
and what then are the implications for instruction? Answering these questions 
involves some small and large inferential leaps. The simplest case to consider is 
the teaching of analogical reasoning perse. The more difficult case is instruction 
lii "aptitudes for learning." 

1 WiiloKY Jnsi ruction. Based on the research we discussed here, we can 
argue that understanding of the analogy task. i.e.. knowledge of the constraints 
of the task, is a logical instructional target inorder to teach analogical reasoning 
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skills. Correct interpretation of the structural representation "A:B :: C:D" is a 
prerequisite for solution ot even the simplest analogies. The requirement that 
solvers consider the match between two relations, and that the two relations be 
chosen according to syntactic rules, can be stressed explicitly during instruction. 
By doing so, one would he providing basic fariiiliarity with the task to solvers 
who would otherwise attempt solutions in ribriarialbgical ways. Such instruction 
would also re tine the knowledge of individuals who have a beginning, but weak, 
understanding o! analogy. Equipped with a strong, appropriately constrained 
goal, solvers at least have a chance to ^rforrri the task of "analogical reason- 
ing. " 

One conceivable way to team :n- vbricepi arid constraints of analogy would be 
to give the student the >k \ »: v:ririiiriatibri among positive arid negative in- 
stances (including "near nibses of analogies. Reasons for decisions could be 
elicited and corrected a^ " sary, with explicit emphasis bri the proper attrib- 
utes of analogies. Iri addition, i.ie "thinking aloud" technique could be adapted 
for use with instructor and. or peer guidance. Individuals could practice solving 
simple analogies while verbalizing their thoughts arid decision making rationales: 
By receiving corrective feedback arid practicing until syntactic errors Were elimi- 
nated, iridividuals ihay acquire clear and strong know-edge of constraints on this 
form of reasoning. 

Ensuring that individuals understand the essemial rne-'iing of analogy does 
hoi, however, guarantee that they will be prolicient in all the strategic problem- 
soiving activities or component processes required for -.jlution of analogies. 
Highly skilled solvers are capable of solving analogies using either 
conceptually-driven or interactive solutions. These solvers can initially identify 
the analogical rule and evaluate the match between A-B and C-D relations. After 
identifying C-D relations in tli available completion terms, skilled solvers use 
these relations to help develop an optimal conceptualization of the unifying 
analogical rule. These behaviors are weak iri lower ability solvers, and it would 
seem that development of instructional methods 7 for teaching these skills Would 
also be a promising area to explore. 

It is important to note, however, that the difficulty of analogy items can be 
rijahipiibicu by increasing their processing demands in various ways: Take as an 
example the case of verbal analogies. If declarative knowledge demands (e.g^ 
vocabulary level) comprise major determinants of item difficulty, increases in 
syntactic or procedural knowledge will be of limited utility to individuals with an 
insufficient knowledge of the language, and procedural knowledge will have an 
inadequate data base. These items remain "vocabulary tests in an anaiogy vehi- 
cle" as WHIner [ 1*4) suggested, and would seem to reveal little about individu- 
; ' ability to reason analogically : If, however, test designers could create items 
h- increasing semantic processing demands without increasing vocabulary level, 
then a well developed repertoire of strategic knowledge would be more appro- 
priately assessed: That is, items containing familiar words but complex, abstract, 
or ambiguous relations are likely to demand solvers' abilities to identify, recon- 
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eeptualize, and refine relations. Analyses of the kind presented in this chapter 
could be used by test constructors to ensure that standardized tests actually 
measure and diagnose appropriate reasoning skills. 

Improved performance on standardized tests is not, of course, the major 
reason for encouraging students to develop analogical reasoning skills. 
Analogies, metaphors, and similes are all common vehicles of expression and 
communication in and out of schools (Ortony, Reynolds, & Arter, 1978). 
Analogical reasoning per se has been referred to as a high level mental activity, 
and has been equated with intelligence (Spearman, 1923; Thurstone & 
Thurstone, 1941). There would appear to be an intrinsic value in analogical 
reasoning as an effective way to think and communicate about the world, thus 
making analogies valuable as test items. In classroom settings, •"teaching by 
analogy" is a mechanism often used to promote students' understanding of new 
information. While the relationship between solving multiple-choice analogy test 
items and learning by analogy has not been ascertained, cenain general specula- 
tions aboui their common demands can be offered. 

Communicating by analogy involves the presentation of a familiar situation 
trom which one is expected io inter important aspects about an unfamiliar situa- 
tion. At the same time, discrepancies between the two ideas must be suspended 
Horn consideration. That is. the learner must be able to distinguish relevant trom 
irrelevant Nation*; and it is assumed that relational features common to both 
situations can rv identmed while dissimilar relations are ignored. It is critical that 
tVvo matching relations be held in mind simultaneously though the two are 
instantiated u> .i.Merenr domains !n most nontest stations, the individual is not 
expected to equate the match between two relations. Hut rather to strive tor and 
discover a match rhut exists and to constnict a new r. presentation ol relations 
from a piesumably bovii :ct. This process is similar to the application ot known 
C- O relations to an uniuimlwr A-i? relation (or iiie convene)— an activity highly 
Skilled solvers are capable ol pcrk>;:iung m Ur s Mudy (Heller; 1979), but one that 
poorer students exhibit less often and with less sophistication. Explicit study ot 
analogical reasoning in learning and instructional environments is necessary if 
ihese processes are to be fully understood. The implications from our studies, 
however, are that specific and identifiable skills may be required for learning by 
analogy, and unless students are capable of the necessary processing, common 
.actional techniques will be relatively ineffective for those students, 

2. Aptitudes for Learning. The analysis of prototypical test tasks must ul- 
timately generate implications tor conceptions of academic learning skills, and 
means by which they can be fostered. Oar speculations on this problem rest upon 
a consideration of the three differentiating aspects of skill that were mentioned 
earlier: (lj memory management, (2) procedural knowledge, and (3) content 
knowledge. The memory management component of skilled performance might 
suggest that one should focus on processing facility and process training such as 
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the employment of rehearsal and organizational strategies of the kinds studied in 
memory experiments. The other two components, however, concerned with 
knowledge representation and problem-solving procedures, suggest a different 
emphasis. Emphasis on memory management suggests a focus on the possibility 
of influencing mental processing skills, e:g:, better methods for searching mem- 
ory and elaborating connections to facilitate storage and retrieval. The literature 
on the training and transfer of such skills indicates that^imple process training 
approaches to improving ihe skills of learning are not very promising (Campione 
Si Brown, 1979): An increasing amount of evidence indicates thai execuujpri of 
such "basic processing" skills is dependent on the content and organization of 
the knowledge base <e:g., Chase & Simon, 1973; Chi, 1978). 

In contrast to "basic process'* training, if one emphasizes training related to 
the knowledge S.ise. i.e., conceptual information and knowledge of problem- 
solving p roc ed ares and constraints, then progress is seen in terms of improving 
the ways in which a knowledge base is activated and manipulated. When highly 
skilled individuals learn something new or undertake a new problem of induc- 
tion, they engage a highly organized structure of appropriate facts, relationships, 
associated procedures, and constraints. Skilled individuals are skilled because of 
their knowledge of the content involved in a problem and their knowledge of the 
procedural constraints of a particular problem form such as inductive or analogi- 
cal reasoning. These two kinds of knowledge interact so that procedural cori : 
siraints are exercised in the content knowledge base, and the knowledge base 
enables procedural goals to be attained. 

This kind of analysis leads us to suggest that the improvement of the skills of 
learning will take place through the exercise and development of procedural 
(problem-solving) knowledge in the context of specific knowledge domains: The 
suggestion is thai learning skills are developed when we teach more than 
mechanisms of recall and recognition for a body of knowledge. Learning skill 
ensues as the content and concepts of a knowledge domain are attained in learn- 
ing situations that constrain this knowledge to serve certain purposes and goals. 
The goals are defined b> cses of this knowledge in procedural schemes such as 
those required in analogical reasoning and inductive inference. 

How this facility could actually be taught is difficult to say at this time. One 
might teach more of the know ledge base and its high level concepts, or one might 
leach procedural knowledge such as planning ahead and recognizing when pro- 
cedural constraints are violated. However, teaching either separately would 
probably be unsuccessful vcause each kind of knowledge Facilitates the je- 
veiopmeni of the other. Learning skills are probably developed through graded 
sequences of experience tiiat combine conceptual and procedural knowledge. 
This is what must lake place when a good instructor develops a series of exam- 
ples that stimulate thinking. 

Finally, there is the problem of diagnosing weaknesses in individuals who are 
unskilled in academic learning. When this is done, we generally find that their 

75 



342 PELLEGRINO AND G LASER 



knowledge base is not rich arid that their skill in maintaining directed use ot th.s 
knowledge is hoi developed. Perhaps a reasonable tactic is to identity some 
attained knowledge base in an individual where instruction can begin. Knowl- 
edge developed in the course of an individual "s prior cultural experience can 
provide knowledge representations and goal-directed behavior that can be ex- 
ploited Knowledge structures exist in varying forms in individuals as a result ot 
prior experiences, and this available knowledge can be transferred to domains ot 
related knowledge that approximate more and more closely the tormal abstrac- 
tions arid procedural requirements necessary for school learning: 

i he goals expressed at the beginning of this chapter should be reiterated at us 
eiid The technology of aptitude measurement appears to have reached an 
asymptote" of procress that cannot be changed without further understanding of 
the deta.K of human cognition. At the present time, scientists are beginning to 
iUehiilS the components of individual differences in terms of modern mtonnalipn 
processing theory: Educators are seeking more than Static measures that predict 
success in learning; they require knowledge of both the ways that abilities tor 
learning can be influenced in educational environments, and ot the limits ol this 
mfluer.ee. It is possible that analysis of the processes and knowledge required by 
tests that have correlated with educational achievement can contribute to provid- 
ing such information. 
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